randomllama commited on
Commit
9eae477
Β·
verified Β·
1 Parent(s): c84a0db

sync: latest measured numbers

Browse files
Files changed (1) hide show
  1. LADDER.md +7 -1
LADDER.md CHANGED
@@ -30,4 +30,10 @@ Kernel tile map for sm_121 (measured): `qo_len` multi-token kernel β†’ small til
30
  Cumulative: 27.6 β†’ 29.7 code (+7.6%) since first light.
31
  | L4v2 | fp8 target KV (tilelang DSA) | β€” | β€” | **CLOSED: architecturally unsupported** β€” SGLang raises `tilelang DSA ... on CUDA requires a bfloat16 KV cache` at arg resolution. Round-1's 64s death explained |
32
 
33
- In progress: L4v3 β€” trtllm DSA backend + fp8 KV (the GB300 reference config; sm_121 support UNKNOWN, one gated boot), then D=4.
 
 
 
 
 
 
 
30
  Cumulative: 27.6 β†’ 29.7 code (+7.6%) since first light.
31
  | L4v2 | fp8 target KV (tilelang DSA) | β€” | β€” | **CLOSED: architecturally unsupported** β€” SGLang raises `tilelang DSA ... on CUDA requires a bfloat16 KV cache` at arg resolution. Round-1's 64s death explained |
32
 
33
+ | L4v3 | trtllm DSA backends + fp8 KV | β€” | β€” | **DIED: `TllmGenFmhaRunner: Unsupported arch`** β€” trtllm FMHA does not support sm_121 |
34
+
35
+ **fp8 target KV verdict on GB10 + SGLang + GLM-5.3: impossible on this stack today.**
36
+ tilelang forbids it on CUDA by upstream policy; trtllm kernels don't build for the chip.
37
+ (vLLM reached fp8 KV on GB10 only via hand-patched CTA tile caps β€” see tonyd2wild's recipe.)
38
+
39
+ In progress: D=4 draft-token test (last cheap experiment), then closeout: final G6 matrix + staged morning update.