Spaces:

apathy-exe
/

Xing4.0-29B-A4B

Running on Zero

apathy-exe commited on about 10 hours ago

Commit

2f93d1d

verified ·

1 Parent(s): 249b2e0

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -115,7 +115,6 @@ def start_llama_server():
         "--spec-type", "draft-mtp",
         "--spec-draft-n-max", "2",
         "--spec-draft-n-min", "1",
-        "--parallel", "1",
         "--cache-type-k", "q8_0",
         "--cache-type-v", "q8_0",
         "--jinja",

         "--spec-type", "draft-mtp",
         "--spec-draft-n-max", "2",
         "--spec-draft-n-min", "1",
         "--cache-type-k", "q8_0",
         "--cache-type-v", "q8_0",
         "--jinja",