Qwen3.6-35B-A3B-heretic (NVFP4)
Up to 740 tok/s aggregate at c=64 — scales without the pre-fix concurrency crash
Aggregate throughput (tok/s) vs concurrent requests · DFlash on aeon-vllm-ultimate:latest · scales cleanly to c=64
0
203
406
610
813
c=1
c=8
c=16
c=32
c=64
Coding
Math
Reasoning
Prose
Natural language
Extraction/JSON