Video Classification
Transformers
Safetensors
vjepa21
feature-extraction
video
vjepa
vjepa2
v-jepa-2.1
self-supervised
world-model
custom_code
Instructions to use apiantonio/vjepa2.1-vit-gigantic-384 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use apiantonio/vjepa2.1-vit-gigantic-384 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("video-classification", model="apiantonio/vjepa2.1-vit-gigantic-384", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("apiantonio/vjepa2.1-vit-gigantic-384", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -43,7 +43,7 @@ fused projection.
|
|
| 43 |
If you want to reproduce the comparisons below, note that `torch.hub.load` against the current
|
| 44 |
`main` of `facebookresearch/vjepa2` does not work: `src/hub/backbones.py` ships with
|
| 45 |
`VJEPA_BASE_URL = "http://localhost:8300"` and the real URL commented out above it. Download the
|
| 46 |
-
checkpoint directly from
|
| 47 |
and build the reference modules from `app/vjepa_2_1/models/`, which is what the shipped scripts do.
|
| 48 |
|
| 49 |
## Architecture
|
|
|
|
| 43 |
If you want to reproduce the comparisons below, note that `torch.hub.load` against the current
|
| 44 |
`main` of `facebookresearch/vjepa2` does not work: `src/hub/backbones.py` ships with
|
| 45 |
`VJEPA_BASE_URL = "http://localhost:8300"` and the real URL commented out above it. Download the
|
| 46 |
+
checkpoint directly from <https://dl.fbaipublicfiles.com/vjepa2/vjepa2_1_vitG_384.pt>
|
| 47 |
and build the reference modules from `app/vjepa_2_1/models/`, which is what the shipped scripts do.
|
| 48 |
|
| 49 |
## Architecture
|