prince-canuma commited on
Commit
614b365
·
verified ·
1 Parent(s): 1226fb0

Restore BF16 model card after CLI reconversion

Browse files
Files changed (1) hide show
  1. README.md +58 -26
README.md CHANGED
@@ -4,38 +4,70 @@ license: apache-2.0
4
  pipeline_tag: image-text-to-text
5
  language:
6
  - en
7
- - de
8
- - fr
9
- - es
10
- - it
11
- - pt
12
- - hi
13
- - ja
14
- - ko
15
- - zh
16
- - ar
17
  tags:
18
- - vision
19
- - multimodal
20
- - conversational
21
- - multilingual
22
- - native-resolution
23
  - mlx
 
 
 
 
 
24
  base_model: CohereLabs/North-Micro-Vision-Instruct
25
  ---
26
 
27
- # mlx-community/North-Micro-Vision-Instruct-bf16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
28
 
29
- This model was converted to MLX format from [`CohereLabs/North-Micro-Vision-Instruct`](https://huggingface.co/CohereLabs/North-Micro-Vision-Instruct)
30
- using mlx-vlm version **0.6.13**.
31
- Refer to the [original model card](https://huggingface.co/CohereLabs/North-Micro-Vision-Instruct) for more details on the model.
 
 
 
 
 
32
 
33
- ## Use with mlx
34
 
35
- ```bash
36
- pip install -U mlx-vlm
37
- ```
38
 
39
- ```bash
40
- python -m mlx_vlm.generate --model mlx-community/North-Micro-Vision-Instruct-bf16 --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>
41
- ```
 
 
 
 
4
  pipeline_tag: image-text-to-text
5
  language:
6
  - en
 
 
 
 
 
 
 
 
 
 
7
  tags:
 
 
 
 
 
8
  - mlx
9
+ - mlx-vlm
10
+ - vision-language
11
+ - multimodal
12
+ - cohere
13
+ - north
14
  base_model: CohereLabs/North-Micro-Vision-Instruct
15
  ---
16
 
17
+ # North Micro Vision Instruct — BF16 (MLX)
18
+
19
+ This repository contains an Apple MLX conversion of
20
+ [CohereLabs/North-Micro-Vision-Instruct](https://huggingface.co/CohereLabs/North-Micro-Vision-Instruct). BF16 MLX weights (no weight quantization).
21
+
22
+ It belongs to the
23
+ [North Vision MLX collection](https://huggingface.co/collections/mlx-community/north-vision-6a7c9be6ccc1cd992a83aecb), which includes BF16, affine
24
+ 4/5/6/8-bit, MXFP4, MXFP8, and NVFP4 variants.
25
+
26
+ ## Conversion details
27
+
28
+ - Source: [CohereLabs/North-Micro-Vision-Instruct](https://huggingface.co/CohereLabs/North-Micro-Vision-Instruct)
29
+ - Format: MLX / MLX-VLM
30
+ - Precision: bfloat16 (unquantized)
31
+ - MLX-VLM source revision: main at 7ee8eba3
32
+
33
+ The repository was regenerated and uploaded directly with the MLX-VLM
34
+ conversion CLI:
35
+
36
+ ~~~bash
37
+ python -m mlx_vlm convert \
38
+ --hf-path CohereLabs/North-Micro-Vision-Instruct \
39
+ --mlx-path North-Micro-Vision-Instruct-bf16 \
40
+ --dtype bfloat16 \
41
+ --upload-repo mlx-community/North-Micro-Vision-Instruct-bf16
42
+ ~~~
43
+
44
+ ## Usage
45
+
46
+ Cohere Compass support is available on the current MLX-VLM main branch.
47
+ Install it directly from GitHub:
48
+
49
+ ~~~bash
50
+ pip install -U "mlx-vlm @ git+https://github.com/Blaizzy/mlx-vlm.git"
51
+ ~~~
52
+
53
+ Run vision-language inference:
54
 
55
+ ~~~bash
56
+ mlx_vlm.generate \
57
+ --model mlx-community/North-Micro-Vision-Instruct-bf16 \
58
+ --image /path/to/image.jpg \
59
+ --prompt "Describe this image." \
60
+ --max-tokens 512 \
61
+ --temperature 0.0
62
+ ~~~
63
 
64
+ You can also pass an image URL to --image.
65
 
66
+ ## Notes
 
 
67
 
68
+ - MLX is optimized for Apple silicon.
69
+ - This repository changes the storage precision/quantization, not the source
70
+ model architecture or intended behavior.
71
+ - Refer to the
72
+ [original model card](https://huggingface.co/CohereLabs/North-Micro-Vision-Instruct) for capabilities,
73
+ limitations, licensing context, and responsible-use guidance.