gemma-4-26B-A4B-it-GGUF-UD-Q4_K_XL

Sleeping

filip-krolop commited on Apr 21

Commit

c6f39b7

verified ·

1 Parent(s): 89e3a6b

Update Dockerfile

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -19,4 +19,7 @@ CMD ["--server", \
      "--host", "0.0.0.0", \
      "--port", "7860", \
      "-t", "2", \
-     "-c", "32000"]

      "--host", "0.0.0.0", \
      "--port", "7860", \
      "-t", "2", \
+     "--cache-type-k", "q8_0", \
+     "--cache-type-v", "iq4_nl", \
+     "-c", "16000", \
+     "-n", "19456"]