Translation
Transformers
Safetensors
cohere2_moe
text-generation
conversational
chat
compressed-tensors
Instructions to use CohereLabs/North-Small-Translate-1.0-fp8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use CohereLabs/North-Small-Translate-1.0-fp8 with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "translation" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("translation", model="CohereLabs/North-Small-Translate-1.0-fp8") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("CohereLabs/North-Small-Translate-1.0-fp8") model = AutoModelForCausalLM.from_pretrained("CohereLabs/North-Small-Translate-1.0-fp8", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
You need to agree to share your contact information to access this model
This repository is publicly accessible, but you have to accept the conditions to access its files and content.
By submitting this form, you agree to the License Agreement and acknowledge that the information you provide will be collected, used, and shared in accordance with Cohere’s Privacy Policy. You’ll receive email updates about Cohere Labs and Cohere research, events, products and services. You can unsubscribe at any time.
Log in or Sign Up to review the conditions and access this model content.
Gated model You can list files but not access them
Preview of files found in this repository
- assets
- 1.65 kB
- 7.27 kB
- 12.3 kB
- 4.33 kB
- 137 Bytes
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.95 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.93 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.99 GB xet
- 4.87 GB xet