Instructions to use lmsys/sglang-EAGLE3-Llama-4-Scout-17B-16E-Instruct-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use lmsys/sglang-EAGLE3-Llama-4-Scout-17B-16E-Instruct-v1 with Transformers:
# Load model directly from transformers import AutoTokenizer, LlamaForCausalLMEagle3 tokenizer = AutoTokenizer.from_pretrained("lmsys/sglang-EAGLE3-Llama-4-Scout-17B-16E-Instruct-v1") model = LlamaForCausalLMEagle3.from_pretrained("lmsys/sglang-EAGLE3-Llama-4-Scout-17B-16E-Instruct-v1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Ctrl+K