sync: latest measured numbers
Browse files
LADDER.md
CHANGED
|
@@ -28,4 +28,6 @@ Kernel tile map for sm_121 (measured): `qo_len` multi-token kernel β small til
|
|
| 28 |
| D6 | speculative-num-draft-tokens 8β6 | **29.7** (27.2β31.0) | **21.5** (20.4β23.4) | **KEPT β new incumbent.** Shorter draft block wastes less verify on doomed tokens at our acceptance profile |
|
| 29 |
|
| 30 |
Cumulative: 27.6 β 29.7 code (+7.6%) since first light.
|
| 31 |
-
|
|
|
|
|
|
|
|
|
| 28 |
| D6 | speculative-num-draft-tokens 8β6 | **29.7** (27.2β31.0) | **21.5** (20.4β23.4) | **KEPT β new incumbent.** Shorter draft block wastes less verify on doomed tokens at our acceptance profile |
|
| 29 |
|
| 30 |
Cumulative: 27.6 β 29.7 code (+7.6%) since first light.
|
| 31 |
+
| L4v2 | fp8 target KV (tilelang DSA) | β | β | **CLOSED: architecturally unsupported** β SGLang raises `tilelang DSA ... on CUDA requires a bfloat16 KV cache` at arg resolution. Round-1's 64s death explained |
|
| 32 |
+
|
| 33 |
+
In progress: L4v3 β trtllm DSA backend + fp8 KV (the GB300 reference config; sm_121 support UNKNOWN, one gated boot), then D=4.
|