sync: latest measured numbers
Browse files
LADDER.md
CHANGED
|
@@ -36,4 +36,7 @@ Cumulative: 27.6 β 29.7 code (+7.6%) since first light.
|
|
| 36 |
tilelang forbids it on CUDA by upstream policy; trtllm kernels don't build for the chip.
|
| 37 |
(vLLM reached fp8 KV on GB10 only via hand-patched CTA tile caps β see tonyd2wild's recipe.)
|
| 38 |
|
| 39 |
-
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
tilelang forbids it on CUDA by upstream policy; trtllm kernels don't build for the chip.
|
| 37 |
(vLLM reached fp8 KV on GB10 only via hand-patched CTA tile caps β see tonyd2wild's recipe.)
|
| 38 |
|
| 39 |
+
| D4 | draft tokens 4 | 28.3 (28.2β28.7) | **23.3** (23.3β23.3) | reverted on code β but best prose of the campaign (+8% vs D6): code peaks at D=6, prose at D=4; D=5 queued |
|
| 40 |
+
| V4/V5 (first attempt) | upstream aa8c950a3 refresh + novel fat tile | β | β | both died pre-kernel on a partial-overlay skew (`hc_attn_to_mlp` β model file and communicator_mhc.py are a coupled pair); rebuilt as V4b/V5b with both files |
|
| 41 |
+
|
| 42 |
+
In progress: V4b (upstream refresh) β V5b (novel fat 1-stage tile, still untested) β D5, then decoupled drafter, fa3, prefill/TTFT, closeout.
|