Instructions to use Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit with MLX:

# Make sure mlx-vlm is installed
# pip install --upgrade mlx-vlm

from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template
from mlx_vlm.utils import load_config

# Load the model
model, processor = load("Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit")
config = load_config("Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit")

# Prepare input
image = ["http://images.cocodataset.org/val2017/000000039769.jpg"]
prompt = "Describe this image."

# Apply chat template
formatted_prompt = apply_chat_template(
    processor, config, prompt, num_images=1
)

# Generate output
output = generate(model, processor, formatted_prompt, image)
print(output)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit"

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent

How to use Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

Justfinethanks commited on Aug 29

Commit

02ac334

verified ·

1 Parent(s): 3673595

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

.gitattributes +1 -0
model-00003-of-00131.safetensors +3 -0
model-00005-of-00131.safetensors +3 -0
model-00006-of-00131.safetensors +3 -0
model-00009-of-00131.safetensors +3 -0
model-00011-of-00131.safetensors +3 -0
model-00012-of-00131.safetensors +3 -0
model-00014-of-00131.safetensors +3 -0
model-00015-of-00131.safetensors +3 -0
model-00017-of-00131.safetensors +3 -0
model-00018-of-00131.safetensors +3 -0
model-00020-of-00131.safetensors +3 -0
model-00022-of-00131.safetensors +3 -0
model-00023-of-00131.safetensors +3 -0
model-00025-of-00131.safetensors +3 -0
model-00026-of-00131.safetensors +3 -0
model-00027-of-00131.safetensors +3 -0
model-00029-of-00131.safetensors +3 -0
model-00031-of-00131.safetensors +3 -0
model-00032-of-00131.safetensors +3 -0
model-00034-of-00131.safetensors +3 -0
model-00037-of-00131.safetensors +3 -0
model-00038-of-00131.safetensors +3 -0
model-00041-of-00131.safetensors +3 -0
model-00042-of-00131.safetensors +3 -0
model-00044-of-00131.safetensors +3 -0
model-00047-of-00131.safetensors +3 -0
model-00048-of-00131.safetensors +3 -0
model-00050-of-00131.safetensors +3 -0
model-00053-of-00131.safetensors +3 -0
model-00054-of-00131.safetensors +3 -0
model-00055-of-00131.safetensors +3 -0
model-00056-of-00131.safetensors +3 -0
model-00059-of-00131.safetensors +3 -0
model-00061-of-00131.safetensors +3 -0
model-00062-of-00131.safetensors +3 -0
model-00063-of-00131.safetensors +3 -0
model-00064-of-00131.safetensors +3 -0
model-00066-of-00131.safetensors +3 -0
model-00067-of-00131.safetensors +3 -0
model-00068-of-00131.safetensors +3 -0
model-00070-of-00131.safetensors +3 -0
model-00073-of-00131.safetensors +3 -0
model-00075-of-00131.safetensors +3 -0
model-00076-of-00131.safetensors +3 -0
model-00079-of-00131.safetensors +3 -0
model-00080-of-00131.safetensors +3 -0
model-00083-of-00131.safetensors +3 -0
model-00085-of-00131.safetensors +3 -0
model-00086-of-00131.safetensors +3 -0

.gitattributes CHANGED Viewed

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text

 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

model-00003-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ed6e1e1b625edc3dce3e9114f54f06fb0d2f6b52faea82a0db55e088b50bbdd6
+size 412521190

model-00005-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ffc9627128344b1ccba3c8c69da0ea9dcc1cba0e9a11ba6a8178cad00115623d
+size 890937704

model-00006-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f42b6d9e911841cc0d3edea9c3b8e13b48055443d3b499ecafa226b3fd5d9a72
+size 1000006799

model-00009-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0fd855b217b16ac805dc44eff2220332dde3eb3c6a4b336302ee4ada5444e0df
+size 1000006809

model-00011-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3da57c0f00dee96bcc9af870367bce15ae68727306b18a79a192053d7a19a74c
+size 1000006807

model-00012-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:70deb9add00c2ae89b91e60dde8acd604bbae14754518da85eb1681b1d73383d
+size 1000006813

model-00014-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9e04c232787b4702f2b259282f3b04ae2d0eac4abf4d969fcefa28c0b2c8e153
+size 1000006807

model-00015-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9beb43c4f810eb1ba3f46625c0081020c262a9afdbaff4ff0fd8bbae251fa4fc
+size 1000006809

model-00017-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9b2cf024b620482f838bae8ba4a7acfc8abb039a183115284fcb71c17aba080c
+size 1000006809

model-00018-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:08c2abc88d7040eca0febc0b04edd980de0d8309db5fad0907a685b4b9c73476
+size 1000006809

model-00020-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fa1d17da5f7208aebde9520e8e318db8aa5c1e4ae8c70a7b4abe03de2b9fc4ac
+size 1000006813

model-00022-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a668a0dbffe5761e4de03eda5d69f956841c60f97cd6965ef166bd1baa90e646
+size 1000006811

model-00023-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:31d747c25644865efc08c57b6b73d8d5b501c6018d1f044f63383c349584a2b6
+size 1000006811

model-00025-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:15bb3d5acbed94266d6e0c81a374b8d7f7a9bc6f0b985443cecd73ca21b79fe9
+size 1000006807

model-00026-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dc6b2a708db7388f94e5492c284d07455e2213a4f6bdbc3f73a30a0ffa784bb4
+size 1000006813

model-00027-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a0bbfe2fceb57da47511b75f71df647ffb3defaf78b09cc36b852a33025a456d
+size 1000006809

model-00029-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9c56f819790eb844c3bdfa0ace2b9442aa6f7fa623fe585946b10992c96e5abd
+size 1000006807

model-00031-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:69b97149a09c05d271120482a72aa610c4fb6c795285b9d5513a9b37963d09ad
+size 1000006819

model-00032-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7d909385ccbb005d6560c3156c5290f108414034dc5add7ea92b1ebc9a3992ab
+size 1000006823

model-00034-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:02f75884a4feb0ee44b4d451c921c84211f1308c0a7fef4cf617bd655eae55d5
+size 1000006823

model-00037-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f12de14ac4f6358480365bb46bd2340e585c12f830a9f181f84325d34aa8480a
+size 540188242

model-00038-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:33550991a31eb0c00f63f630a85209477851ef75aa9f140a88cbb07304db45bb
+size 734004168

model-00041-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0c4f7f11cd58c0f5e41b0b5ea7911f36e797c466dfcd42a628da3de58213ced1
+size 443307127

model-00042-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bb61a7fcba99e5bfa96c7c4c3590bd851972f09c6c868b8318cb16a11fc5398b
+size 734004170

model-00044-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f9a8bdce9aa0a324a886ff2ba1a3ac69dc11b5418b363f084d765bca8a1e9637
+size 734004170

model-00047-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:57cd93f7a322ebf01a69d4b5be39c4f140e3d3fffce0bd0882af05a3135fd045
+size 379881249

model-00048-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d5456bdb88b6b215c3c97003b76ddbde89f50b25f362091da7a971aa8bb45bc3
+size 734004170

model-00050-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1c75fcdbc1a54153d8ffd073c181a19dd7e2b83f1ceaf8c745ff173b4708c32c
+size 734004174

model-00053-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1fcf51da2eca1b9491d7d7e1251bd5a4bb20e723572e22d2a3dccdd72c24f824
+size 414364889

model-00054-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:647fea5506e7fe0f8f66e37b3a78ac0848a897f1b179e508a8f71147beb554b9
+size 734004170

model-00055-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d7b4819bc676002c6b739abebb764e32c10af6296e0d03e8e74d5e61fdc73655
+size 379857853

model-00056-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e2b72e6238a510067ff26a384bbcf83f0157469e819419cf061ac226f6f1be68
+size 734004170

model-00059-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7277acab4d5984dbe8fd049fb3551ba45969a5443f5ca4c00ff71933117217bc
+size 379858031

model-00061-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:28e57fbf7260796bc9c67becc261806bdf4a2b2c8c1fb47c86f3d60bac1d4789
+size 734004170

model-00062-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9c7da28ab83939c10d879292d9e9d07a26d90ccf9196563a857112304aa388b6
+size 884380835

model-00063-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d943d13ce7689360ba55d70f0d66f8112796be2809c8ba063076e41de4ea07e0
+size 734004172

model-00064-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7f14c4a8b70ff2fd0ac8c7f2a3a8fe65c6fed0275d9e4966c33cf936a4deac70
+size 412521263

model-00066-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:afcc0eea26455dcc6b18bac885dc586cfa34aea8cf3ccc3ad865092c02445907
+size 382479411

model-00067-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2063d6f2d1b474dc21803d9ea5f1e14a15ae80f5041adeea5469e5b0523bf2e5
+size 734004170

model-00068-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a45724ee62e6d31dea47d676174c02238017097bcda2300d34432e73bc43a24e
+size 441463513

model-00070-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f5db905f11a16c96a17382a9fed2f4caa6790b50d27b23e4ecf79a7e6d7400ba
+size 412526485

model-00073-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0a4fa9f1488a1cf915cb035b5d8ece249918688499771b7047d849f15c7ff060
+size 734004170

model-00075-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:514e7a69ae1baf4739c2c3c3f6abab0e3c6581eca45a8d2e099446b6401972d1
+size 734004168

model-00076-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:67cb6c5de16c49e6b6e7a8ad79922d2f2db974fa1c39acc608956c7df5950339
+size 442385492

model-00079-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fd737ea453b41319cbef69cf8f88065dfb7610157bf1317b73caf1007a2a0cc9
+size 734004170

model-00080-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4f6055a4a5f652a333dd9a1a8b720ea590814451b4444b21f225baab0ffd074d
+size 379857873

model-00083-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f29c32612bcc3d41c6fdb791413c1123663ee680464e7b34b7c50fbb698023b6
+size 734004170

model-00085-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d3345c59fe005de2040df7cd45c5cb500169cadff1ffb71a0485a5b6a3808a83
+size 734004168

model-00086-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a475b6191734d444b44a51f1ce73e332366d85ce24d361326a126d208c37e512
+size 443307154