anthonyya (Anthony A)

liked 2 models 7 days ago

z-lab/Qwen3.8-27B-DFlash2

Text Generation • 2B • Updated 6 days ago • 65k • 224

z-lab/Qwen3.8-27B-DFlash2-GGUF

Text Generation • 2B • Updated about 13 hours ago • 53.9k • 85

liked 2 models 12 days ago

MiniMaxAI/MiniMax-Music3

Text-to-Audio • 2B • Updated 11 days ago • 18.7k • 1.24k

Qwen/Qwen3.8-27B

Image-Text-to-Text • 28B • Updated 11 days ago • 2.95M • • 12.6k

liked a model 15 days ago

froggeric/Qwen-Fixed-Chat-Templates

Updated about 15 hours ago • 1.46k

commented on Block Diffusion on Apple Silicon with 3.7× Speedup for Qwopus 3.6 27B 23 days ago

Ignore my previous comment as I was testing the configuration on llama.cpp, which isn't as optimized as MLX based frameworks. However after trying this on mlx-vlm, I'm actually curious how you got this running long enough for your sanity testing. I tried to test it myself, and mlx-vlm is currently suffering from intense RAM spikes (4x the usage) which then very quickly causes OOMs. I opened an issue and I am working with collaborators who confirmed this is an issue.

liked a model 23 days ago

lemuralabs/Qwen3.6-27B-V2-abliterated-uncensored-6-bit-mlx

Image-Text-to-Text • 6B • Updated 20 days ago • 1.64k • 3

updated a model 23 days ago

anthonyya/Qwen3.6-27B-DFlash-8bit

Text Generation • 0.5B • Updated 23 days ago • 295

published a model 23 days ago

anthonyya/Qwen3.6-27B-DFlash-8bit

Text Generation • 0.5B • Updated 23 days ago • 295

updated a model 23 days ago

anthonyya/Qwen3.6-27B-DFlash-4bit

Text Generation • 0.3B • Updated 23 days ago • 337

published a model 23 days ago

anthonyya/Qwen3.6-27B-DFlash-4bit

Text Generation • 0.3B • Updated 23 days ago • 337

updated a model 23 days ago

anthonyya/Qwen3.6-27B-DFlash-6bit

Text Generation • 0.4B • Updated 23 days ago • 118

published a model 23 days ago

anthonyya/Qwen3.6-27B-DFlash-6bit

Text Generation • 0.4B • Updated 23 days ago • 118

New activity in Alittlehammmer/Qwen3.6-27B-DFlash-GGUF-llama.cpp 24 days ago

Are quants required to match?

#1 opened 24 days ago by

anthonyya

commented on Block Diffusion on Apple Silicon with 3.7× Speedup for Qwopus 3.6 27B 24 days ago

Can you run this on a real benchmark? I tested this on my M4 Max with a real coding benchmark and I'm not seeing anything close to your 55 tok/s, I'm getting around 20.