Instructions to use avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw with MLX:

# Make sure mlx-vlm is installed
# pip install --upgrade mlx-vlm

from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template
from mlx_vlm.utils import load_config

# Load the model
model, processor = load("avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw")
config = load_config("avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw")

# Prepare input
image = ["http://images.cocodataset.org/val2017/000000039769.jpg"]
prompt = "Describe this image."

# Apply chat template
formatted_prompt = apply_chat_template(
    processor, config, prompt, num_images=1
)

# Generate output
output = generate(model, processor, formatted_prompt, image)
print(output)

Notebooks
Google Colab
Kaggle
Local Apps Settings
LM Studio

How to use avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw with Pi:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw"

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "mlx-lm": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent

How to use avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw with Hermes Agent:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw"

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw with OpenClaw:

Start the MLX server

# Install MLX LM:
uv tool install mlx-lm
# Start a local OpenAI-compatible server:
mlx_lm.server --model "avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw"

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw" \
  --custom-provider-id mlx-lm \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

avlp12 commited on Jul 21

Commit

3b5748a

verified ·

1 Parent(s): a3cbbe8

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

model-00002-of-00108.safetensors +3 -0
model-00003-of-00108.safetensors +3 -0
model-00004-of-00108.safetensors +3 -0
model-00005-of-00108.safetensors +3 -0
model-00006-of-00108.safetensors +3 -0
model-00009-of-00108.safetensors +3 -0
model-00011-of-00108.safetensors +3 -0
model-00012-of-00108.safetensors +3 -0
model-00014-of-00108.safetensors +3 -0
model-00017-of-00108.safetensors +3 -0
model-00018-of-00108.safetensors +3 -0
model-00019-of-00108.safetensors +3 -0
model-00020-of-00108.safetensors +3 -0
model-00023-of-00108.safetensors +3 -0
model-00025-of-00108.safetensors +3 -0
model-00026-of-00108.safetensors +3 -0
model-00029-of-00108.safetensors +3 -0
model-00031-of-00108.safetensors +3 -0
model-00032-of-00108.safetensors +3 -0
model-00033-of-00108.safetensors +3 -0
model-00034-of-00108.safetensors +3 -0
model-00036-of-00108.safetensors +3 -0
model-00037-of-00108.safetensors +3 -0
model-00038-of-00108.safetensors +3 -0
model-00039-of-00108.safetensors +3 -0
model-00040-of-00108.safetensors +3 -0
model-00041-of-00108.safetensors +3 -0
model-00042-of-00108.safetensors +3 -0
model-00043-of-00108.safetensors +3 -0
model-00044-of-00108.safetensors +3 -0
model-00045-of-00108.safetensors +3 -0
model-00047-of-00108.safetensors +3 -0
model-00048-of-00108.safetensors +3 -0
model-00050-of-00108.safetensors +3 -0
model-00053-of-00108.safetensors +3 -0
model-00055-of-00108.safetensors +3 -0
model-00056-of-00108.safetensors +3 -0
model-00059-of-00108.safetensors +3 -0
model-00061-of-00108.safetensors +3 -0
model-00062-of-00108.safetensors +3 -0
model-00064-of-00108.safetensors +3 -0
model-00065-of-00108.safetensors +3 -0
model-00067-of-00108.safetensors +3 -0
model-00068-of-00108.safetensors +3 -0
model-00070-of-00108.safetensors +3 -0
model-00072-of-00108.safetensors +3 -0
model-00073-of-00108.safetensors +3 -0
model-00075-of-00108.safetensors +3 -0
model-00076-of-00108.safetensors +3 -0
model-00077-of-00108.safetensors +3 -0

model-00002-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e9edc3e900a6a03f1744d4b8949501389b34ba22a41945d4c2b08ecb391d881b
+size 2850594035

model-00003-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:05f95197001fa2920ef16bf3095a136614553e29085c7766b4d46193bcd9c817
+size 4391554491

model-00004-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:912863caa92e90a1324e5dbeaa766ba5b17e09e8b8c92a2613db25fa7df4ca83
+size 4152537583

model-00005-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b29d93e1d0a6e403babe92a2683b0ce22b6c3cdfc3e1e23151fdd8c153d96137
+size 4001368578

model-00006-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:43993e6252e893662c6b93a22c4c36162a95a5cb12726e861e1559d2ac014a4a
+size 4231147216

model-00009-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:65c485a72fbff1c315ab8825c6e6e383cfc64246bad65282d1e1460d4d0791e1
+size 2117179214

model-00011-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:702576bd063b430ec519abcda02e5b683089229382012af685c6be9ed72366a1
+size 4583534829

model-00012-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:63524e58483c853d885dbd0619e694f62781b056a011d626c0126889dc8c47e3
+size 3925935617

model-00014-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cfc9498dc9a787676bc7dd116464ac975d5c2e55d6c395deb1ebf671492cd080
+size 3925869720

model-00017-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bef3e41e557b69aefcb86c083b3c3511b25d8c582ec7c8433ab8e2d72e309a9d
+size 2076194403

model-00018-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e7e440e34ada0f5e49566f505b12a6745a8d01440e69c9d8d42c1148fa2aea11
+size 4290932585

model-00019-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f6ec6d41db2ae6fb861a39f6c15227b8b068eb8bf51e41dde38e62f1d0686d12
+size 1962935440

model-00020-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:105984c96d941d059df9a150e546139f50a2696fdc53ff770b22b1f2299edba8
+size 4246912745

model-00023-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:77265b7c07e236dac2736794200d7c8bdf820b6b3c8b4676331f8bf08653f37a
+size 4357104937

model-00025-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4b1d1297e8b6431b2ff0bbc35ed44d15331ea13f7b252ee50a43dfe6f75baebe
+size 4328660816

model-00026-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:da79a013fb2efd127fc0857be8dac7b707d60fca23d3d9add35e06b8a649f90d
+size 4596098888

model-00029-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3a66964b3f08fad9a30bdb34b42481ada320ce0ba8b484c7562fdb7cf4334aae
+size 4227876351

model-00031-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1ed673b98f1574a7fa1dedaaca0bb7cb8e84ba3dd76e4f23c82b636d65c60f34
+size 2344071127

model-00032-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1d068bb395d11057cc4896f7acbb9ecae65686a8561f67e426a1a77c7df0320c
+size 4454708164

model-00033-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d618cc3e20cb84a7c2f393acb41b7232d7fb9e04e5f2f8c38f98bd4ed80c2d44
+size 4080115024

model-00034-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f3505064245328c8b57d9cb69052a9f535b198e6196d4bf083c0840ec725829f
+size 4114632065

model-00036-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:20a91650531166dbea116931a5e921874e099a282937fbbfb36f19a18dfd1ee2
+size 4539535519

model-00037-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ae9e24856e0ce7c21d64f7112b1a368dbab499e9634a84d45dde921626ca7cfa
+size 4528784376

model-00038-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:efd252f56c485c0c6c29f5b2b102a9dd811ef20106aad071b50bdb4df0dc5bec
+size 4001368677

model-00039-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7fb63efe68e4b5dbe6a58d463824b132930e46d8d5e3b0fff17e06a7aa23e5b6
+size 4001591071

model-00040-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:aedb0fc5a54e00acb0e19ed51ef5b3b749633d7be4fa15a1b3e4de554057ad49
+size 4328577511

model-00041-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5a59d1f4b09f83d50898521829b6d65fc330376267e2c17602174202f61508b0
+size 4139974626

model-00042-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:275db06c31da3ca5f67e1d1ff007d1e973c2ffe7aad96ea4eaba78dbc518aa7f
+size 4514395551

model-00043-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c98b7c3b1acf7c741b87025d4d91c211d9f0f47f07bcd56dc23e8dd29e19abc2
+size 4168231333

model-00044-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fed7f1b78962a780a0ac44ca75686341ad6cd467865bea220b77f7fe944bb3a4
+size 5295318621

model-00045-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1be19546a0cd3275ba40502b350a6a1c1e052b9a5d85a9d9087b1b9e418364fe
+size 4511072762

model-00047-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b851bf965b7e58d3f2192e6d6911005d234799fc88abc70d0137600723729f17
+size 3925886702

model-00048-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2edb570f42f247087fb83b2897548c40881a36ee9f37533e9fe42959bae7d45b
+size 4206084381

model-00050-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a52b30544f260fe015d74799b9c983ea0881419ccbc7a01f487fefc1c456d753
+size 2391027224

model-00053-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bfef00fed652857870b1adfe51ad46b52455696c4772851effee954074d89a3c
+size 4328775149

model-00055-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6dfb54e855020a605c7a5a52a3cb59dd32b4530a9f1978f0777a45494b695cf4
+size 717244128

model-00056-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c48a522a0661e86657c2b9764d6379f0b46167b14007d03c57e23cd7d6c80180
+size 4042366298

model-00059-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b3b5f4281ac7745da19593372ba692cf322161575e5c84478f9fea30ac9bd0df
+size 4555033972

model-00061-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b3cf0a5d3bab56392c3de299001332706fa55b3476f7384512ae87fe6a009865
+size 4168180365

model-00062-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:265d0be5f2911d190080079a01bc1c308af9bac0e60dd16251e451e8b466ce82
+size 4043867769

model-00064-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9c01966cd63f85252c70a1d048edb2efdf7ebcaafe4f3b93eff6ed5817032e43
+size 4042303653

model-00065-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:444281532a64cf9f49943b113ece7af7ed1fdb65796714fe5bd3afc800305acc
+size 4026533128

model-00067-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6132ee3bfb069360cfa3fb766a75c2ea24403a1c1a255577f3edd29f22753666
+size 4253054811

model-00068-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ffe15c90a5e52c5b9668dd2e7d4f9688ae86c74e9e4532b02c2fe7f16df4d854
+size 1962936568

model-00070-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a0b6c2f1e3a81f9780af122547aaefec1ea657bdfddf766f196632643ca315ec
+size 4253306064

model-00072-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c30d341f6328934de8c44f4024badac159973156e9c1589d950506bf2b8c1a17
+size 4574051837

model-00073-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f57c5e52e556999d95f44a7ed2e66a86c0a16d71003932e06740dab70e555743
+size 4215296034

model-00075-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:99d98697daa423d08d671c8decbb350490a3b3d53a53da684df0e6d827303439
+size 1975544516

model-00076-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:55459888397e0c72f744c16caab2f1c560aa533707af3f0b0db325885c6aa4da
+size 4520773953

model-00077-of-00108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ca52e972fbf7f2da7dcbdba706c1daead4ba6a58462e682518eca88e6a897d46
+size 1962947960