README: community-first intro
Browse files
README.md
CHANGED
|
@@ -14,12 +14,17 @@ tags:
|
|
| 14 |
|
| 15 |
# GLM-5.3-Flash + DFlash2 on 2× NVIDIA DGX Spark (GB10) — SGLang TP=2 recipe
|
| 16 |
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
|
| 22 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
|
| 24 |
## Measured (warmed, temp 0, stream:false, 800 tok, n=5 medians, stock clocks)
|
| 25 |
| prompt | DFlash2 ON | no-spec same stack | speedup |
|
|
|
|
| 14 |
|
| 15 |
# GLM-5.3-Flash + DFlash2 on 2× NVIDIA DGX Spark (GB10) — SGLang TP=2 recipe
|
| 16 |
|
| 17 |
+
Hey — I'm one of the folks running DGX Sparks at home, and this community's recipes are
|
| 18 |
+
the only reason my cluster works at all. tonyd2wild's GB10 forensics, MiaAI-Lab's
|
| 19 |
+
dual-Spark configs, hasso5703's DFlash2 writeup, LibertAIDAI's quant card — I've leaned
|
| 20 |
+
on all of them, so here's mine back.
|
| 21 |
|
| 22 |
+
This is GLM-5.3-Flash with the incoai DFlash2 drafter on the **SGLang** path (the
|
| 23 |
+
PR [#36507](https://github.com/sgl-project/sglang/pull/36507) branch everyone will get
|
| 24 |
+
by default once it merges). Getting it to boot on GB10 took a night and four fixes
|
| 25 |
+
nobody had written down yet — they're all here with patches and probes, so your
|
| 26 |
+
bring-up should take an hour instead. If you hit something new, open an issue and
|
| 27 |
+
I'll dig in with you.
|
| 28 |
|
| 29 |
## Measured (warmed, temp 0, stream:false, 800 tok, n=5 medians, stock clocks)
|
| 30 |
| prompt | DFlash2 ON | no-spec same stack | speedup |
|