randomllama commited on
Commit
7a53d78
·
verified ·
1 Parent(s): f6bc13b

README: community-first intro

Browse files
Files changed (1) hide show
  1. README.md +10 -5
README.md CHANGED
@@ -14,12 +14,17 @@ tags:
14
 
15
  # GLM-5.3-Flash + DFlash2 on 2× NVIDIA DGX Spark (GB10) — SGLang TP=2 recipe
16
 
17
- First published deployment of [incoai/GLM-5.3-Flash-DFlash2](https://huggingface.co/incoai/GLM-5.3-Flash-DFlash2)
18
- drafting for [LibertAIDAI/GLM-5.3-Flash-NVFP4](https://huggingface.co/LibertAIDAI/GLM-5.3-Flash-NVFP4)
19
- on the upstream **SGLang** path (PR [#36507](https://github.com/sgl-project/sglang/pull/36507) branch,
20
- incl. #36708), on consumer Blackwell (sm_121).
21
 
22
- **Source of truth & full recipe:** https://github.com/beastllama/GLM-5.3-Flash-DFlash2-SGLang-2x-DGX-Spark
 
 
 
 
 
23
 
24
  ## Measured (warmed, temp 0, stream:false, 800 tok, n=5 medians, stock clocks)
25
  | prompt | DFlash2 ON | no-spec same stack | speedup |
 
14
 
15
  # GLM-5.3-Flash + DFlash2 on 2× NVIDIA DGX Spark (GB10) — SGLang TP=2 recipe
16
 
17
+ Hey I'm one of the folks running DGX Sparks at home, and this community's recipes are
18
+ the only reason my cluster works at all. tonyd2wild's GB10 forensics, MiaAI-Lab's
19
+ dual-Spark configs, hasso5703's DFlash2 writeup, LibertAIDAI's quant card — I've leaned
20
+ on all of them, so here's mine back.
21
 
22
+ This is GLM-5.3-Flash with the incoai DFlash2 drafter on the **SGLang** path (the
23
+ PR [#36507](https://github.com/sgl-project/sglang/pull/36507) branch everyone will get
24
+ by default once it merges). Getting it to boot on GB10 took a night and four fixes
25
+ nobody had written down yet — they're all here with patches and probes, so your
26
+ bring-up should take an hour instead. If you hit something new, open an issue and
27
+ I'll dig in with you.
28
 
29
  ## Measured (warmed, temp 0, stream:false, 800 tok, n=5 medians, stock clocks)
30
  | prompt | DFlash2 ON | no-spec same stack | speedup |