Instructions to use Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit with MLX:

# Make sure mlx-vlm is installed
# pip install --upgrade mlx-vlm

from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template
from mlx_vlm.utils import load_config

# Load the model
model, processor = load("Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit")
config = load_config("Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit")

# Prepare input
image = ["http://images.cocodataset.org/val2017/000000039769.jpg"]
prompt = "Describe this image."

# Apply chat template
formatted_prompt = apply_chat_template(
    processor, config, prompt, num_images=1
)

# Generate output
output = generate(model, processor, formatted_prompt, image)
print(output)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit"

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent

How to use Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "Sawfwair/Qwen3.8-Flash-Next-MLX-Activation-3bit" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

Justfinethanks commited on Aug 29

Commit

c699bd6

verified ·

1 Parent(s): 02ac334

Add files using upload-large-folder tool

Browse files

Files changed (21) hide show

model-00002-of-00131.safetensors +3 -0
model-00007-of-00131.safetensors +3 -0
model-00008-of-00131.safetensors +3 -0
model-00010-of-00131.safetensors +3 -0
model-00028-of-00131.safetensors +3 -0
model-00030-of-00131.safetensors +3 -0
model-00043-of-00131.safetensors +3 -0
model-00046-of-00131.safetensors +3 -0
model-00049-of-00131.safetensors +3 -0
model-00051-of-00131.safetensors +3 -0
model-00069-of-00131.safetensors +3 -0
model-00071-of-00131.safetensors +3 -0
model-00082-of-00131.safetensors +3 -0
model-00088-of-00131.safetensors +3 -0
model-00109-of-00131.safetensors +3 -0
model-00111-of-00131.safetensors +3 -0
model-00114-of-00131.safetensors +3 -0
model-00123-of-00131.safetensors +3 -0
model-00126-of-00131.safetensors +3 -0
model-00129-of-00131.safetensors +3 -0
model-00131-of-00131.safetensors +3 -0

model-00002-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8cb268e8790ae39e86d807fda2855795fddb3c6bcdf4fccb326a7051090e9e4a
+size 734004166

model-00007-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7aadd6078dcaa86aab035deb0c08c11e092127d63effab92c469cdba1214676a
+size 1000006795

model-00008-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2262ee6c2ee34a0273bd440b435d03e16c05d67b73c252ca0f8a80549d842a8d
+size 1000006811

model-00010-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aa2684de2089897bd213b8bfd5d2af2f8e8bc2c87eb6ce5799e9ecbf7e577026
+size 1000006807

model-00028-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9fb6e4f4517700342f7c11515e1489f4a77fdf23815ade5f798ad3bef0ffae9a
+size 1000006813

model-00030-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ef8d28e6a438a905d92a3f2958c638f82fb7debfe6cd32be4e75af93ea09bc00
+size 1000006817

model-00043-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:18d28356ff17c2da535da92f37073adb587bc06e2632dea497f439c86c1a983b
+size 414364799

model-00046-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:40835c1d35f960b932833dffc318df2591033266ff44e34912a3a669482a6cd8
+size 734004170

model-00049-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:89186198a28bd22790492f834b206ddb4c10190d2f4d28b1bcf9547a3c833ee3
+size 441484123

model-00051-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b0af3e31335323110d0742f7d7dceb3b56dbc4f018bb56353d829a7c1161d6fb
+size 412521257

model-00069-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d0b8c6d49b2378c7ab7cfe5a5c46d87a1eef5666d23e04d91ec11a8a04e83abc
+size 734004168

model-00071-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:230401c231c58932cbac8d9190ccef0f6dc666f09df510b688a6a3075216f1d0
+size 734004172

model-00082-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a95a2e269a572d990ad307a8828d810f3e78417f9e79f6e181294d1b35829a05
+size 441484053

model-00088-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f5945c713cc871cd073db7511ba6af1be2df52d0e2c6b01e8b06ee1fef6b83c9
+size 414364850

model-00109-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:483e7df3d4741cfb9685c701387920b82ac4ad8b3f58cd05dfc1693fdcd3b662
+size 734004170

model-00111-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b5c02c4414582f9df76bb168d35659216789aaff6228935a50f03d76e7905b74
+size 734004170

model-00114-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e574f1eb67c04de315ac6998bcaec52ce6387c3bfc9c0a933694d2901df90dae
+size 412526463

model-00123-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:89917dca38aeb4101462273f599956bc4e8007be1f755e050ecd913c669f0cda
+size 734004166

model-00126-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c170eba57535ae046f643f37d65550db0dadf7407ce846ee664bdb0807225b45
+size 441463425

model-00129-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:76bae5ac6fc125533f52000ff484a60aea43dfb047db181acdd6abbd9ccc809e
+size 734004166

model-00131-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8927757dfd7ffe45e81062c4387c6a14779a3d98b4adb2dba3fffb4a9e42aef
+size 357581254