Image-Text-to-Text
MLX
Safetensors
mistral3
mistral-common
ministral
ministral-3
vision-language
multimodal
quantized
edge
6-bit
base-model
Instructions to use mlx-community/Ministral-3-8B-Base-2512-6bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/Ministral-3-8B-Base-2512-6bit with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("mlx-community/Ministral-3-8B-Base-2512-6bit") config = load_config("mlx-community/Ministral-3-8B-Base-2512-6bit") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -19,15 +19,69 @@ extra_gated_description: If you want to learn more about how we process your per
|
|
| 19 |
tags:
|
| 20 |
- mistral-common
|
| 21 |
- mlx
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
pipeline_tag: image-text-to-text
|
| 23 |
base_model: mistralai/Ministral-3-8B-Base-2512
|
| 24 |
---
|
| 25 |
|
| 26 |
# mlx-community/Ministral-3-8B-Base-2512-6bit
|
| 27 |
|
| 28 |
-
This
|
| 29 |
-
|
| 30 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
|
| 32 |
## Use with mlx
|
| 33 |
|
|
@@ -38,3 +92,10 @@ pip install -U mlx-vlm
|
|
| 38 |
```bash
|
| 39 |
python -m mlx_vlm.generate --model mlx-community/Ministral-3-8B-Base-2512-6bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
|
| 40 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
tags:
|
| 20 |
- mistral-common
|
| 21 |
- mlx
|
| 22 |
+
- ministral
|
| 23 |
+
- ministral-3
|
| 24 |
+
- vision-language
|
| 25 |
+
- multimodal
|
| 26 |
+
- quantized
|
| 27 |
+
- edge
|
| 28 |
+
- 6-bit
|
| 29 |
+
- base-model
|
| 30 |
pipeline_tag: image-text-to-text
|
| 31 |
base_model: mistralai/Ministral-3-8B-Base-2512
|
| 32 |
---
|
| 33 |
|
| 34 |
# mlx-community/Ministral-3-8B-Base-2512-6bit
|
| 35 |
|
| 36 |
+
This is, **Ministral 3 8B Base 2512** is a vision-language model: a text backbone paired
|
| 37 |
+
with a vision encoder, supporting image understanding alongside text. This is
|
| 38 |
+
the **base pre-trained** checkpoint — not instruction- or chat-tuned. For
|
| 39 |
+
chat/instruction-following use cases, use the
|
| 40 |
+
[Instruct variant](https://huggingface.co/mlx-community/Ministral-3-8B-Instruct-2512-6bit)
|
| 41 |
+
instead; this base checkpoint is intended for custom post-training/fine-tuning.
|
| 42 |
+
|
| 43 |
+
> **Community note.** Structural check confirms the vision tower and
|
| 44 |
+
> multimodal projector were carried over intact (not dropped, which is a real
|
| 45 |
+
> failure mode for text-only conversion tools on vision-language models).
|
| 46 |
+
> Functional check confirms both text-only and image+text generation produce
|
| 47 |
+
> coherent output. Converted and verified by a single maintainer running
|
| 48 |
+
> local MLX tooling -- not independently reviewed by anyone else; please open
|
| 49 |
+
> a discussion if you hit anything unexpected.
|
| 50 |
+
|
| 51 |
+
This is an MLX conversion of [`mistralai/Ministral-3-8B-Base-2512`](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512),
|
| 52 |
+
converted with [mlx-vlm](https://github.com/Blaizzy/mlx-vlm). Refer to the
|
| 53 |
+
[original model card](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512) for the full
|
| 54 |
+
description, capabilities, and license terms.
|
| 55 |
+
|
| 56 |
+
## Heads up
|
| 57 |
+
|
| 58 |
+
- **Base model, not instruct-tuned** — expect raw completion behavior, not
|
| 59 |
+
chat-following. Don't expect it to follow instructions well.
|
| 60 |
+
- **Vision retained at full precision** — only the language backbone is
|
| 61 |
+
quantized; the vision tower and multimodal projector are untouched bf16,
|
| 62 |
+
per mlx-vlm's standard policy of not quantizing multimodal modules.
|
| 63 |
+
- **Output size on disk: 8.43GB**
|
| 64 |
+
|
| 65 |
+
## Provenance
|
| 66 |
+
|
| 67 |
+
- Source: [`mistralai/Ministral-3-8B-Base-2512`](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512) (BF16)
|
| 68 |
+
- Language model layers: **6-bit** affine quantization, group_size=64
|
| 69 |
+
- Vision tower + multimodal projector: kept at full precision (not quantized)
|
| 70 |
+
- Blended average: **7.529 bits per weight** across all parameters
|
| 71 |
+
|
| 72 |
+
## Ministral 3 family
|
| 73 |
+
|
| 74 |
+
| Model | Type | mlx-community (4-bit) |
|
| 75 |
+
|---|---|---|
|
| 76 |
+
| Ministral 3 3B Base 2512 | Base pre-trained | [mlx-community/Ministral-3-3B-Base-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-3B-Base-2512-4bit) |
|
| 77 |
+
| Ministral 3 3B Instruct 2512 | Instruct post-trained | [mlx-community/Ministral-3-3B-Instruct-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-3B-Instruct-2512-4bit) |
|
| 78 |
+
| Ministral 3 3B Reasoning 2512 | Reasoning capable | [mlx-community/Ministral-3-3B-Reasoning-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-3B-Reasoning-2512-4bit) |
|
| 79 |
+
| Ministral 3 8B Base 2512 | Base pre-trained | [mlx-community/Ministral-3-8B-Base-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-8B-Base-2512-4bit) |
|
| 80 |
+
| Ministral 3 8B Instruct 2512 | Instruct post-trained | [mlx-community/Ministral-3-8B-Instruct-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-8B-Instruct-2512-4bit) |
|
| 81 |
+
| Ministral 3 8B Reasoning 2512 | Reasoning capable | [mlx-community/Ministral-3-8B-Reasoning-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-8B-Reasoning-2512-4bit) |
|
| 82 |
+
| Ministral 3 14B Base 2512 | Base pre-trained | [mlx-community/Ministral-3-14B-Base-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-14B-Base-2512-4bit) |
|
| 83 |
+
| Ministral 3 14B Instruct 2512 | Instruct post-trained | [mlx-community/Ministral-3-14B-Instruct-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-14B-Instruct-2512-4bit) |
|
| 84 |
+
| Ministral 3 14B Reasoning 2512 | Reasoning capable | [mlx-community/Ministral-3-14B-Reasoning-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-14B-Reasoning-2512-4bit) |
|
| 85 |
|
| 86 |
## Use with mlx
|
| 87 |
|
|
|
|
| 92 |
```bash
|
| 93 |
python -m mlx_vlm.generate --model mlx-community/Ministral-3-8B-Base-2512-6bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
|
| 94 |
```
|
| 95 |
+
|
| 96 |
+
For text-only prompts, omit `--image`.
|
| 97 |
+
|
| 98 |
+
## License
|
| 99 |
+
|
| 100 |
+
Apache 2.0 — see the [original model card](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512) for
|
| 101 |
+
the full license text and any usage terms.
|