Model card for clipkd-released-ViT-B-16-teacher-cc12m

ViT-B/16 teacher pretrained on CC3M+12M. ImageNet acc: 36.99%

Model Details

• Architecture: ViT-B-16
• Method: CLIP-KD
• Training Data: CC3M+CC12M
• ImageNet Top-1: 37.0%
• Original Repo: https://github.com/winycg/CLIP-KD
• Paper: CLIP-KD: An Empirical Study of CLIP Model Distillation (CVPR 2024)

Model Usage

import open_clip

model, _, preprocess = open_clip.create_model_and_transforms(
    'hf-hub:fassabilf/clipkd-released-ViT-B-16-teacher-cc12m'
)
tokenizer = open_clip.get_tokenizer('hf-hub:fassabilf/clipkd-released-ViT-B-16-teacher-cc12m')