Image-Text-to-Text
MLX
Safetensors
English
Korean
Chinese
inkling_mm_model
audio-text-to-text
quantized
mixture-of-experts
Mixture of Experts
multimodal
apple-silicon
mixed-precision
3-bit
dwq
conversational
Instructions to use avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw") config = load_config("avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent
How to use avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "avlp12/Inkling-975B-Alis-MLX-Dynamic-3.7bpw" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Add files using upload-large-folder tool
Browse files- model-00001-of-00108.safetensors +3 -0
- model-00007-of-00108.safetensors +3 -0
- model-00008-of-00108.safetensors +3 -0
- model-00010-of-00108.safetensors +3 -0
- model-00013-of-00108.safetensors +3 -0
- model-00015-of-00108.safetensors +3 -0
- model-00016-of-00108.safetensors +3 -0
- model-00021-of-00108.safetensors +3 -0
- model-00022-of-00108.safetensors +3 -0
- model-00024-of-00108.safetensors +3 -0
- model-00027-of-00108.safetensors +3 -0
- model-00028-of-00108.safetensors +3 -0
- model-00030-of-00108.safetensors +3 -0
- model-00035-of-00108.safetensors +3 -0
- model-00046-of-00108.safetensors +3 -0
- model-00049-of-00108.safetensors +3 -0
- model-00051-of-00108.safetensors +3 -0
- model-00052-of-00108.safetensors +3 -0
- model-00054-of-00108.safetensors +3 -0
- model-00057-of-00108.safetensors +3 -0
- model-00058-of-00108.safetensors +3 -0
- model-00060-of-00108.safetensors +3 -0
- model-00063-of-00108.safetensors +3 -0
- model-00066-of-00108.safetensors +3 -0
- model-00069-of-00108.safetensors +3 -0
- model-00071-of-00108.safetensors +3 -0
- model-00074-of-00108.safetensors +3 -0
- model-00082-of-00108.safetensors +3 -0
- model-00087-of-00108.safetensors +3 -0
- model-00090-of-00108.safetensors +3 -0
- model-00093-of-00108.safetensors +3 -0
- model-00095-of-00108.safetensors +3 -0
- model-00096-of-00108.safetensors +3 -0
- model-00099-of-00108.safetensors +3 -0
- model-00100-of-00108.safetensors +3 -0
- model-00103-of-00108.safetensors +3 -0
- model-00105-of-00108.safetensors +3 -0
- model-00106-of-00108.safetensors +3 -0
- model-00107-of-00108.safetensors +3 -0
model-00001-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:72bd7ba9dc2137459d35bde75afa42beaf15b4c25920a8f0c16796bdaa6c4e7f
|
| 3 |
+
size 12280987357
|
model-00007-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:79b4214219a6d2ebbe0737c5fe364f80014318833e3264ce9ab7ababc6f7029e
|
| 3 |
+
size 4127406774
|
model-00008-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:caf755dcecf511c4a3f4b227e2f83ff6640cce712354e1cc71c6ed64a4debcf1
|
| 3 |
+
size 3925869720
|
model-00010-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c26b16988bcc5e666647ccc47ecd307e2eebf97181098248507aac01b253834b
|
| 3 |
+
size 4177895222
|
model-00013-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:247420145ef6d2c3fcb21c2c141e0c65c1d02b5b9227ba950a576eea641d5cc3
|
| 3 |
+
size 2025932835
|
model-00015-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f39904ce284115ffb66316354035ef8f6d76124922522023f02bed3506d8ee01
|
| 3 |
+
size 4029703536
|
model-00016-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ba3a75466f2e188cdde1186e751f3f57ac42a3f1d850ad083a072e300181c0c2
|
| 3 |
+
size 4256253042
|
model-00021-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ac9ab7d1729f4eafd768c369d4c94215f8dfc4fc665e88de72e3d2029e8666fa
|
| 3 |
+
size 4530126293
|
model-00022-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9ee02170fffc64f44fd89efb9fdb4643a30ff46111bc4816c584d31e2abe89f0
|
| 3 |
+
size 2519813581
|
model-00024-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ecb386ea803440f224f134ad93fd83febbcf5b9fdef3c513366d9388fda6bf48
|
| 3 |
+
size 4064402340
|
model-00027-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f1d4a2a813c81583a40bbac88582f9fef49b23abd60e9a964d756ba5162b0e8c
|
| 3 |
+
size 4051768266
|
model-00028-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4ad570cd247625b312eda019d1ddba15491a8cef599ec9d0a90dcf1ea87076bc
|
| 3 |
+
size 4382104825
|
model-00030-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2180e293bcc654c7ca84d5009c1a0d1dbb2b9aed9152f31e0ab94d2a6e4a48f2
|
| 3 |
+
size 3938469376
|
model-00035-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:481b0c6ab8bd9bfa6190730953beccd41088a4b01206e431e06fa2ed9fbec6b5
|
| 3 |
+
size 3938502135
|
model-00046-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c40e245107977488b8d466184065e76bcacce8ff63a17fb99c1309b61319b872
|
| 3 |
+
size 3507789534
|
model-00049-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7d5b038aad3e8e59362ef82464e932007982bccea4c64449234030758eac670d
|
| 3 |
+
size 4574191253
|
model-00051-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8caa89110deb4d49fbe54df7951b398198541c6c641c0dc9d34c0207253bd68f
|
| 3 |
+
size 4026600146
|
model-00052-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b72a623fbfef3b00be4a416eb25e50011ae77b3464ba311be4cbdf452127cb1a
|
| 3 |
+
size 3032872149
|
model-00054-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1a16429ba5a8563fd8956fc9c29b8c4a6eae6996ccce1a18c24289292189851e
|
| 3 |
+
size 4039116284
|
model-00057-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d1414d0f68405b439f5b9c9a6efc9109d10d94b403461b524fb0bdfd13987519
|
| 3 |
+
size 4199816682
|
model-00058-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:524d51b5d8276fd5a2b0a368ce8b736ab4eedeb517cbb3706a437b167d61c700
|
| 3 |
+
size 4240485859
|
model-00060-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5927366cd877c2a39e0fe93cfb953a0d6d3ce08000803487fea34956bd0ad826
|
| 3 |
+
size 4054918860
|
model-00063-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a1be3514c73d4cef718fed38c95661a8325a896b2e35dc127ddd20e50795d277
|
| 3 |
+
size 3925869720
|
model-00066-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fccee24cc5807b15c28c4e581d74b8702898c9613773adbdaee6d92bb9691d65
|
| 3 |
+
size 3929053757
|
model-00069-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:77d4646a8309a18276e7939382d3a22838c66938b0145175d34e187485ffac6e
|
| 3 |
+
size 4504896361
|
model-00071-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:672cc0e73bada86439372c546ede3ccfaaea6e8cf671684016c11dff52e502f7
|
| 3 |
+
size 2302824449
|
model-00074-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d361fc1084e39b76ff17ed03a75fa17b56e36aaeb3516cc71dc0492c08a179a2
|
| 3 |
+
size 3925869720
|
model-00082-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:751569819db858992209c3988d134b48cc5cc5eee597ad8718d6a53baa2e7bbb
|
| 3 |
+
size 4353825857
|
model-00087-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7cd3bc9b0a485bb70be02b04c7b61082d9a71d221246b69963157fc321419d8a
|
| 3 |
+
size 4378934234
|
model-00090-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7363255155388bdf6953ae578fe7e4f88c4ba49cb9e2ac72b5e23211c8c85f0b
|
| 3 |
+
size 3108167078
|
model-00093-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eaa389307092bc4ef361e4a5c92315c41f4634876c2fde7529e9eddb2946c364
|
| 3 |
+
size 3951035648
|
model-00095-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:afbfbd0491e4364ebc8b0b4c0726f1b093182d97a28fe31b7042798a8bdce8f5
|
| 3 |
+
size 4127245792
|
model-00096-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f19a1e82bf11eba6e675159f0a3ed35543df637b836a47062c041e9f446421c4
|
| 3 |
+
size 4180848666
|
model-00099-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b04d411038829471002430aec1303b52de477aca0d7c99c07bf4e97715b1b43f
|
| 3 |
+
size 4180908901
|
model-00100-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9dc0d95764c481e5132838573fa022324b58ac176350a3726e61d791cfabdd6b
|
| 3 |
+
size 2390890411
|
model-00103-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:41d48f930f77de6bb34cb3b6e487f32bc48dad06b47081d752e3f945b55f480f
|
| 3 |
+
size 2038433760
|
model-00105-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6f6cc6e2863441834b2ef74040c8127634c6c2e3b267424af55f7e506ec2ad88
|
| 3 |
+
size 4573995429
|
model-00106-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1ab0bd73dd2373cf0e59406811d50c9286e009e8483aa989146216c4e7497bbd
|
| 3 |
+
size 4114659725
|
model-00107-of-00108.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e00e3031666223e36b384455d11fe4f6653d77b2e89d683523c7987db2844221
|
| 3 |
+
size 19428017316
|