aadex commited on
Commit
fe37394
·
verified ·
1 Parent(s): b9bb53f

Add model card

Browse files
Files changed (1) hide show
  1. README.md +45 -0
README.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - vision-transformer
4
+ - image-classification
5
+ - fire
6
+ - imagenet100
7
+ license: apache-2.0
8
+ ---
9
+
10
+ # Fire Vit - IMAGENET100
11
+
12
+ This model was trained using the vit-analysis framework.
13
+
14
+ ## Model Details
15
+
16
+ - **Model Type:** FIRE Vision Transformer
17
+ - **Dataset:** imagenet100
18
+ - **Best Accuracy:** 74.48%
19
+ - **Image Size:** 224
20
+ - **Patch Size:** 16
21
+ - **Hidden Dim:** 192
22
+ - **Depth:** 12
23
+ - **Num Heads:** 3
24
+ - **MLP Dim:** 768
25
+ - **Num Classes:** 100
26
+
27
+ ## Training Configuration
28
+
29
+ - **Epochs:** 120
30
+ - **Batch Size:** 512
31
+ - **Learning Rate:** 0.004
32
+ - **Weight Decay:** 0.05
33
+ - **Label Smoothing:** 0.1
34
+
35
+ ## Usage
36
+
37
+ ```python
38
+ import torch
39
+ from models import FIRESimpleVisionTransformer
40
+
41
+ # Load checkpoint
42
+ checkpoint = torch.load('fire_vit_imagenet100_best.pth')
43
+ model = ... # Initialize model with same config
44
+ model.load_state_dict(checkpoint['state_dict'])
45
+ ```