How to use divydeep/granite-speech-4.1-2b-mlx-5bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir granite-speech-4.1-2b-mlx-5bit divydeep/granite-speech-4.1-2b-mlx-5bit
f6194f1 da53ca8
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:f9800db1b68ebf112d29b337a9d923892ff0e7a36b8b56f3718be057d04008d4 size 2802075924
