Lil2J commited on
Commit
1577e3d
·
verified ·
1 Parent(s): 4b2419b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -11,8 +11,6 @@ After implementing Eagle3, the inference performance of Qwen3-8B using the SGLan
11
 
12
  The TPS (tokens per second) improvement reached nearly 70%.
13
 
14
- To use Eagle3 with SGLang, first replace the qwen3_moe.py file in SGLang’s directory (sglang/python/sglang/srt/models/) with the qwen3_moe.py file from this project.
15
-
16
 
17
  | model | gpu | tps |
18
  |---------|---------|---------|
@@ -23,6 +21,9 @@ To use Eagle3 with SGLang, first replace the qwen3_moe.py file in SGLang’s dir
23
 
24
  ## How to use
25
 
 
 
 
26
  The launch command for using Eagle3 with SGLang is:
27
 
28
  ```python3
 
11
 
12
  The TPS (tokens per second) improvement reached nearly 70%.
13
 
 
 
14
 
15
  | model | gpu | tps |
16
  |---------|---------|---------|
 
21
 
22
  ## How to use
23
 
24
+ To use Eagle3 with SGLang, first replace the qwen3_moe.py file in SGLang’s directory (sglang/python/sglang/srt/models/) with the qwen3_moe.py file from this project.
25
+
26
+
27
  The launch command for using Eagle3 with SGLang is:
28
 
29
  ```python3