randomllama commited on
Commit
a486ba9
Β·
verified Β·
1 Parent(s): 9eae477

sync: latest measured numbers

Browse files
Files changed (1) hide show
  1. LADDER.md +4 -1
LADDER.md CHANGED
@@ -36,4 +36,7 @@ Cumulative: 27.6 β†’ 29.7 code (+7.6%) since first light.
36
  tilelang forbids it on CUDA by upstream policy; trtllm kernels don't build for the chip.
37
  (vLLM reached fp8 KV on GB10 only via hand-patched CTA tile caps β€” see tonyd2wild's recipe.)
38
 
39
- In progress: D=4 draft-token test (last cheap experiment), then closeout: final G6 matrix + staged morning update.
 
 
 
 
36
  tilelang forbids it on CUDA by upstream policy; trtllm kernels don't build for the chip.
37
  (vLLM reached fp8 KV on GB10 only via hand-patched CTA tile caps β€” see tonyd2wild's recipe.)
38
 
39
+ | D4 | draft tokens 4 | 28.3 (28.2–28.7) | **23.3** (23.3–23.3) | reverted on code β€” but best prose of the campaign (+8% vs D6): code peaks at D=6, prose at D=4; D=5 queued |
40
+ | V4/V5 (first attempt) | upstream aa8c950a3 refresh + novel fat tile | β€” | β€” | both died pre-kernel on a partial-overlay skew (`hc_attn_to_mlp` β€” model file and communicator_mhc.py are a coupled pair); rebuilt as V4b/V5b with both files |
41
+
42
+ In progress: V4b (upstream refresh) β†’ V5b (novel fat 1-stage tile, still untested) β†’ D5, then decoupled drafter, fa3, prefill/TTFT, closeout.