Instructions to use kyutai/moshika-mlx-q8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Moshi
How to use kyutai/moshika-mlx-q8 with Moshi:
# pip install moshi_mlx # Run local inference (macOS Apple Silicon) python -m moshi_mlx.local -q 8 --hf-repo "kyutai/moshika-mlx-q8" # Or run with web UI python -m moshi_mlx.local_web -q 8 --hf-repo "kyutai/moshika-mlx-q8"
- Notebooks
- Google Colab
- Kaggle
Does not work on M2 MacBook with 24GB of memory
#2 opened over 1 year ago
by
CRJ4WM