File size: 846 Bytes
fe37394 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 | ---
tags:
- vision-transformer
- image-classification
- fire
- imagenet100
license: apache-2.0
---
# Fire Vit - IMAGENET100
This model was trained using the vit-analysis framework.
## Model Details
- **Model Type:** FIRE Vision Transformer
- **Dataset:** imagenet100
- **Best Accuracy:** 74.48%
- **Image Size:** 224
- **Patch Size:** 16
- **Hidden Dim:** 192
- **Depth:** 12
- **Num Heads:** 3
- **MLP Dim:** 768
- **Num Classes:** 100
## Training Configuration
- **Epochs:** 120
- **Batch Size:** 512
- **Learning Rate:** 0.004
- **Weight Decay:** 0.05
- **Label Smoothing:** 0.1
## Usage
```python
import torch
from models import FIRESimpleVisionTransformer
# Load checkpoint
checkpoint = torch.load('fire_vit_imagenet100_best.pth')
model = ... # Initialize model with same config
model.load_state_dict(checkpoint['state_dict'])
```
|