pipenetwork/Muse-Glimmer-30B-MLX-3bit
Image-Text-to-Text • 7B • Updated • 530
Muse-Glimmer 30B MLX
Apple Silicon (MLX) build of Muse-Glimmer-30B, plus the runtime no released mlx-vlm has: github.com/PipeNetwork/muse-glimmer-mlx
Note 18.1 GB. ppl 7.44 vs bf16's 6.32 (+17.7%). Coherent but loops and follows instructions less directly. 2-bit was built, measured at ppl 78, and withheld.
pipenetwork/Muse-Glimmer-30B-MLX-8bit
Image-Text-to-Text • 11B • Updated • 387Note 34.6 GB. Statistically indistinguishable from bf16: ppl 6.3224 either way, worse on only 25 of 48 windows, interval straddling zero.
pipenetwork/Muse-Glimmer-30B-MLX-4bit
Image-Text-to-Text • 7B • Updated • 364Note 21.3 GB. ppl 6.5206 (+3.1%). Measurable on every window but small - the best size/quality trade on the ladder.