Translation
Transformers
Safetensors
JAX
t5
text2text-generation
text-generation-inference
8-bit precision
bitsandbytes
Instructions to use Emilio407/madlad400-7b-mt-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Emilio407/madlad400-7b-mt-8bit with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "translation" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("translation", model="Emilio407/madlad400-7b-mt-8bit")# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("Emilio407/madlad400-7b-mt-8bit") model = AutoModelForSeq2SeqLM.from_pretrained("Emilio407/madlad400-7b-mt-8bit", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 9077ef936b669a62e91356a145c58ab02bcafece4bd40036b067c5c0b1fb2d2d
- Size of remote file:
- 4.99 GB
- SHA256:
- 8ec859bfc2c00ec33995ef5c378fbe2b7c5be0b2c8f51bcbbd4d56626ea060c4
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.