sync: latest measured numbers
Browse files
LADDER.md
CHANGED
|
@@ -30,4 +30,10 @@ Kernel tile map for sm_121 (measured): `qo_len` multi-token kernel β small til
|
|
| 30 |
Cumulative: 27.6 β 29.7 code (+7.6%) since first light.
|
| 31 |
| L4v2 | fp8 target KV (tilelang DSA) | β | β | **CLOSED: architecturally unsupported** β SGLang raises `tilelang DSA ... on CUDA requires a bfloat16 KV cache` at arg resolution. Round-1's 64s death explained |
|
| 32 |
|
| 33 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
Cumulative: 27.6 β 29.7 code (+7.6%) since first light.
|
| 31 |
| L4v2 | fp8 target KV (tilelang DSA) | β | β | **CLOSED: architecturally unsupported** β SGLang raises `tilelang DSA ... on CUDA requires a bfloat16 KV cache` at arg resolution. Round-1's 64s death explained |
|
| 32 |
|
| 33 |
+
| L4v3 | trtllm DSA backends + fp8 KV | β | β | **DIED: `TllmGenFmhaRunner: Unsupported arch`** β trtllm FMHA does not support sm_121 |
|
| 34 |
+
|
| 35 |
+
**fp8 target KV verdict on GB10 + SGLang + GLM-5.3: impossible on this stack today.**
|
| 36 |
+
tilelang forbids it on CUDA by upstream policy; trtllm kernels don't build for the chip.
|
| 37 |
+
(vLLM reached fp8 KV on GB10 only via hand-patched CTA tile caps β see tonyd2wild's recipe.)
|
| 38 |
+
|
| 39 |
+
In progress: D=4 draft-token test (last cheap experiment), then closeout: final G6 matrix + staged morning update.
|