How to use fixie-ai/ultravox-v0_5-llama-3_2-1b with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("fixie-ai/ultravox-v0_5-llama-3_2-1b", trust_remote_code=True, device_map="auto")
This ensures BC for transformers v4
Thank you!
· Sign up or log in to comment
