randomllama commited on
Commit
c84a0db
Β·
verified Β·
1 Parent(s): 344991c

sync: latest measured numbers

Browse files
Files changed (1) hide show
  1. LADDER.md +3 -1
LADDER.md CHANGED
@@ -28,4 +28,6 @@ Kernel tile map for sm_121 (measured): `qo_len` multi-token kernel β†’ small til
28
  | D6 | speculative-num-draft-tokens 8β†’6 | **29.7** (27.2–31.0) | **21.5** (20.4–23.4) | **KEPT β€” new incumbent.** Shorter draft block wastes less verify on doomed tokens at our acceptance profile |
29
 
30
  Cumulative: 27.6 β†’ 29.7 code (+7.6%) since first light.
31
- In progress: L4 fp8-target-KV autopsy (log capture), then D=4.
 
 
 
28
  | D6 | speculative-num-draft-tokens 8β†’6 | **29.7** (27.2–31.0) | **21.5** (20.4–23.4) | **KEPT β€” new incumbent.** Shorter draft block wastes less verify on doomed tokens at our acceptance profile |
29
 
30
  Cumulative: 27.6 β†’ 29.7 code (+7.6%) since first light.
31
+ | L4v2 | fp8 target KV (tilelang DSA) | β€” | β€” | **CLOSED: architecturally unsupported** β€” SGLang raises `tilelang DSA ... on CUDA requires a bfloat16 KV cache` at arg resolution. Round-1's 64s death explained |
32
+
33
+ In progress: L4v3 β€” trtllm DSA backend + fp8 KV (the GB300 reference config; sm_121 support UNKNOWN, one gated boot), then D=4.