Instructions to use luiscalisto/EuroMoE-2.6B-A0.6B-Instruct-2512-MLX-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use luiscalisto/EuroMoE-2.6B-A0.6B-Instruct-2512-MLX-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir EuroMoE-2.6B-A0.6B-Instruct-2512-MLX-4bit luiscalisto/EuroMoE-2.6B-A0.6B-Instruct-2512-MLX-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
| {% for message in messages %}{% if message['role'] == 'assistant' %}{% set role = 'assistant' %}{% else %}{% set role = message['role'] %}{% endif %}<|im_start|>{{ role }} | |
| {{ message['content'] | trim }}<|im_end|> | |
| {% endfor %}{% if add_generation_prompt %}{{'<|im_start|>assistant | |
| '}}{% endif %} |