Instructions to use mlx-community/3b-hi-pretrain-research_release-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/3b-hi-pretrain-research_release-6bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir 3b-hi-pretrain-research_release-6bit mlx-community/3b-hi-pretrain-research_release-6bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
mlx-community/3b-hi-pretrain-research_release-6bit
This model was converted to MLX format from canopylabs/3b-hi-pretrain-research_release using mlx-vlm version 0.0.3.
Refer to the original model card for more details on the model.
Use with mlx
pip install -U mlx-audio
python -m mlx_audio.tts.generate --model mlx-community/3b-hi-pretrain-research_release-6bit --text "Hello, world"
- Downloads last month
- 4
Hardware compatibility
Log In to add your hardware
Quantized
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support
Model tree for mlx-community/3b-hi-pretrain-research_release-6bit
Base model
meta-llama/Llama-3.2-3B-Instruct Finetuned
canopylabs/orpheus-3b-0.1-pretrained