Snarcy commited on
Commit
ffd0240
·
verified ·
1 Parent(s): d62fec0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +150 -8
README.md CHANGED
@@ -1,8 +1,150 @@
1
- ---
2
- tags:
3
- - image-classification
4
- - timm
5
- library_name: timm
6
- license: apache-2.0
7
- ---
8
- # Model card for RadioDino-s16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ tags:
4
+ - radiomics
5
+ - medical-imaging
6
+ - vision-transformer
7
+ - dino
8
+ - dinov2
9
+ - feature-extraction
10
+ - foundation-model
11
+ library_name: timm
12
+ datasets:
13
+ - medmnist
14
+ - radimagenet
15
+ - BUSI
16
+ pipeline_tag: feature-extraction
17
+ model-index:
18
+ - name: RadioDINO-s16
19
+ results:
20
+ - task:
21
+ type: image-classification
22
+ name: Image Classification
23
+ dataset:
24
+ name: MedMNISTv2
25
+ type: BreastMNIST
26
+ metrics:
27
+ - type: F1
28
+ value: 88.98
29
+ - task:
30
+ type: image-classification
31
+ name: Image Classification
32
+ dataset:
33
+ name: MedMNISTv2
34
+ type: PneumoniaMNIST
35
+ metrics:
36
+ - type: F1
37
+ value: 90.86
38
+ - task:
39
+ type: image-classification
40
+ name: Image Classification
41
+ dataset:
42
+ name: MedMNISTv2
43
+ type: OrganAMNIST
44
+ metrics:
45
+ - type: F1
46
+ value: 96.47
47
+ - task:
48
+ type: image-classification
49
+ name: Image Classification
50
+ dataset:
51
+ name: MedMNISTv2
52
+ type: OrganCMNIST
53
+ metrics:
54
+ - type: F1
55
+ value: 93.63
56
+ - task:
57
+ type: image-classification
58
+ name: Image Classification
59
+ dataset:
60
+ name: MedMNISTv2
61
+ type: OrganSMNIST
62
+ metrics:
63
+ - type: F1
64
+ value: 77.73
65
+ - task:
66
+ type: image-classification
67
+ name: Image Classification
68
+ dataset:
69
+ name: BUSI
70
+ type: BUSI
71
+ metrics:
72
+ - type: F1
73
+ value: 81.83
74
+
75
+ ---
76
+
77
+ # RadioDINO-s16
78
+
79
+ **RadioDINO-s16** is a self-supervised Vision Transformer foundation model developed for radiomics and medical imaging. It is based on the DINO framework and pretrained on the large-scale **RadImageNet** dataset (1.35 million CT, MRI, and Ultrasound images across 165 classes and 11 anatomical regions). This model is part of the *Radio DINO* family and was created to extract robust, general-purpose features for downstream medical tasks including classification, segmentation, and interpretability analysis.
80
+
81
+ Unlike traditional radiomics methods that rely on handcrafted features and supervised models pretrained on natural images, RadioDINO-s16 offers a domain-adapted alternative that consistently outperforms previous models on diverse medical benchmarks. It has been rigorously validated on the MedMNISTv2 benchmark suite and shown to be effective even without fine-tuning.
82
+
83
+ > 🧠 Developed by [Luca Zedda](https://orcid.org/0009-0001-8488-1612), [Andrea Loddo](https://orcid.org/0000-0002-6571-3816), and [Cecilia Di Ruberto](https://orcid.org/0000-0003-4641-0307)
84
+ > 🏥 Department of Mathematics and Computer Science, University of Cagliari
85
+ > 📄 Published in: Computers in Biology and Medicine, 2025
86
+
87
+ ---
88
+
89
+
90
+ ## Model Details
91
+
92
+ - **Architecture:** ViT-small with patch size 16 (`s16`)
93
+ - **SSL framework:** DINO (self-distillation without labels)
94
+ - **Pretraining dataset:** RadImageNet (1.35M CT/MRI/Ultrasound images)
95
+ - **Embedding size:** 384
96
+ - **Applications:** Feature extraction, classification backbones, transfer learning, medical imaging analysis
97
+
98
+ ## Example Usage
99
+
100
+ ```python
101
+ from PIL import Image
102
+ from torchvision import transforms
103
+ import timm
104
+ import torch
105
+
106
+ # Load model from Hugging Face Hub
107
+ model = timm.create_model("hf_hub:Snarcy/RadioDino-s16", pretrained=True)
108
+ model.eval()
109
+ device = "cuda" if torch.cuda.is_available() else "cpu"
110
+ model.to(device)
111
+
112
+ # Load and preprocess a sample image
113
+ image = Image.open("path/to/your/image").convert("RGB")
114
+ transform = transforms.Compose([
115
+ transforms.Resize((224, 224)),
116
+ transforms.ToTensor(),
117
+ transforms.Normalize(mean=[0.485, 0.456, 0.406],
118
+ std=[0.229, 0.224, 0.225]),
119
+ ])
120
+ input_tensor = transform(image).unsqueeze(0).to(device)
121
+
122
+ # Forward pass to obtain feature embedding
123
+ with torch.no_grad():
124
+ embedding = model(input_tensor)
125
+
126
+ ```
127
+
128
+ ## 📝 Citation
129
+
130
+ If you use this model, please cite the following paper:
131
+
132
+ **Radio DINO: A foundation model for advanced radiomics and AI-driven medical imaging analysis**
133
+ Luca Zedda, Andrea Loddo, Cecilia Di Ruberto
134
+ Computers in Biology and Medicine, Volume 195, 2025, 110583
135
+ [https://doi.org/10.1016/j.compbiomed.2025.110583](https://doi.org/10.1016/j.compbiomed.2025.110583)
136
+
137
+ ```bibtex
138
+ @article{ZEDDA2025110583,
139
+ title = {Radio DINO: A foundation model for advanced radiomics and AI-driven medical imaging analysis},
140
+ journal = {Computers in Biology and Medicine},
141
+ volume = {195},
142
+ pages = {110583},
143
+ year = {2025},
144
+ issn = {0010-4825},
145
+ doi = {https://doi.org/10.1016/j.compbiomed.2025.110583},
146
+ url = {https://www.sciencedirect.com/science/article/pii/S0010482525009345},
147
+ author = {Luca Zedda and Andrea Loddo and Cecilia {Di Ruberto}},
148
+ keywords = {Radiomics, Self-supervised learning, Deep learning, DINO, DINOV2, Medical imaging, Feature extraction, Generalizability},
149
+ }
150
+ ```