mabaeyens commited on
Commit
02b69c1
·
verified ·
1 Parent(s): ce54fff

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +64 -3
README.md CHANGED
@@ -19,15 +19,69 @@ extra_gated_description: If you want to learn more about how we process your per
19
  tags:
20
  - mistral-common
21
  - mlx
 
 
 
 
 
 
 
 
22
  pipeline_tag: image-text-to-text
23
  base_model: mistralai/Ministral-3-8B-Base-2512
24
  ---
25
 
26
  # mlx-community/Ministral-3-8B-Base-2512-6bit
27
 
28
- This model was converted to MLX format from [`mistralai/Ministral-3-8B-Base-2512`](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512)
29
- using mlx-vlm version **0.6.5**.
30
- Refer to the [original model card](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512) for more details on the model.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
31
 
32
  ## Use with mlx
33
 
@@ -38,3 +92,10 @@ pip install -U mlx-vlm
38
  ```bash
39
  python -m mlx_vlm.generate --model mlx-community/Ministral-3-8B-Base-2512-6bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
40
  ```
 
 
 
 
 
 
 
 
19
  tags:
20
  - mistral-common
21
  - mlx
22
+ - ministral
23
+ - ministral-3
24
+ - vision-language
25
+ - multimodal
26
+ - quantized
27
+ - edge
28
+ - 6-bit
29
+ - base-model
30
  pipeline_tag: image-text-to-text
31
  base_model: mistralai/Ministral-3-8B-Base-2512
32
  ---
33
 
34
  # mlx-community/Ministral-3-8B-Base-2512-6bit
35
 
36
+ This is, **Ministral 3 8B Base 2512** is a vision-language model: a text backbone paired
37
+ with a vision encoder, supporting image understanding alongside text. This is
38
+ the **base pre-trained** checkpoint not instruction- or chat-tuned. For
39
+ chat/instruction-following use cases, use the
40
+ [Instruct variant](https://huggingface.co/mlx-community/Ministral-3-8B-Instruct-2512-6bit)
41
+ instead; this base checkpoint is intended for custom post-training/fine-tuning.
42
+
43
+ > **Community note.** Structural check confirms the vision tower and
44
+ > multimodal projector were carried over intact (not dropped, which is a real
45
+ > failure mode for text-only conversion tools on vision-language models).
46
+ > Functional check confirms both text-only and image+text generation produce
47
+ > coherent output. Converted and verified by a single maintainer running
48
+ > local MLX tooling -- not independently reviewed by anyone else; please open
49
+ > a discussion if you hit anything unexpected.
50
+
51
+ This is an MLX conversion of [`mistralai/Ministral-3-8B-Base-2512`](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512),
52
+ converted with [mlx-vlm](https://github.com/Blaizzy/mlx-vlm). Refer to the
53
+ [original model card](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512) for the full
54
+ description, capabilities, and license terms.
55
+
56
+ ## Heads up
57
+
58
+ - **Base model, not instruct-tuned** — expect raw completion behavior, not
59
+ chat-following. Don't expect it to follow instructions well.
60
+ - **Vision retained at full precision** — only the language backbone is
61
+ quantized; the vision tower and multimodal projector are untouched bf16,
62
+ per mlx-vlm's standard policy of not quantizing multimodal modules.
63
+ - **Output size on disk: 8.43GB**
64
+
65
+ ## Provenance
66
+
67
+ - Source: [`mistralai/Ministral-3-8B-Base-2512`](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512) (BF16)
68
+ - Language model layers: **6-bit** affine quantization, group_size=64
69
+ - Vision tower + multimodal projector: kept at full precision (not quantized)
70
+ - Blended average: **7.529 bits per weight** across all parameters
71
+
72
+ ## Ministral 3 family
73
+
74
+ | Model | Type | mlx-community (4-bit) |
75
+ |---|---|---|
76
+ | Ministral 3 3B Base 2512 | Base pre-trained | [mlx-community/Ministral-3-3B-Base-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-3B-Base-2512-4bit) |
77
+ | Ministral 3 3B Instruct 2512 | Instruct post-trained | [mlx-community/Ministral-3-3B-Instruct-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-3B-Instruct-2512-4bit) |
78
+ | Ministral 3 3B Reasoning 2512 | Reasoning capable | [mlx-community/Ministral-3-3B-Reasoning-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-3B-Reasoning-2512-4bit) |
79
+ | Ministral 3 8B Base 2512 | Base pre-trained | [mlx-community/Ministral-3-8B-Base-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-8B-Base-2512-4bit) |
80
+ | Ministral 3 8B Instruct 2512 | Instruct post-trained | [mlx-community/Ministral-3-8B-Instruct-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-8B-Instruct-2512-4bit) |
81
+ | Ministral 3 8B Reasoning 2512 | Reasoning capable | [mlx-community/Ministral-3-8B-Reasoning-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-8B-Reasoning-2512-4bit) |
82
+ | Ministral 3 14B Base 2512 | Base pre-trained | [mlx-community/Ministral-3-14B-Base-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-14B-Base-2512-4bit) |
83
+ | Ministral 3 14B Instruct 2512 | Instruct post-trained | [mlx-community/Ministral-3-14B-Instruct-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-14B-Instruct-2512-4bit) |
84
+ | Ministral 3 14B Reasoning 2512 | Reasoning capable | [mlx-community/Ministral-3-14B-Reasoning-2512-4bit](https://huggingface.co/mlx-community/Ministral-3-14B-Reasoning-2512-4bit) |
85
 
86
  ## Use with mlx
87
 
 
92
  ```bash
93
  python -m mlx_vlm.generate --model mlx-community/Ministral-3-8B-Base-2512-6bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
94
  ```
95
+
96
+ For text-only prompts, omit `--image`.
97
+
98
+ ## License
99
+
100
+ Apache 2.0 — see the [original model card](https://huggingface.co/mistralai/Ministral-3-8B-Base-2512) for
101
+ the full license text and any usage terms.