Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ tags:
|
|
| 10 |
---
|
| 11 |
[exllamav3](https://github.com/turboderp-org/exllamav3) quantizations of [Mistral-Large-Instruct-2407](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407)
|
| 12 |
|
| 13 |
-
|
| 14 |
|
| 15 |
[1.40 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.4bpw_H4) 20.820 GiB
|
| 16 |
[1.60 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.60bpw_H4) 23.670 GiB
|
|
@@ -22,5 +22,5 @@ Will update this space with links to the quant branches as they finish uploading
|
|
| 22 |
[3.50 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/3.50bpw_H6) 50.697 GiB
|
| 23 |
[4.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/4.00bpw_H6) 57.795 GiB
|
| 24 |
[5.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/5.00bpw_H6) 71.975 GiB
|
| 25 |
-
6.00 bpw/H6 86.155 GiB
|
| 26 |
-
8.00 bpw/H8 114.609 GiB
|
|
|
|
| 10 |
---
|
| 11 |
[exllamav3](https://github.com/turboderp-org/exllamav3) quantizations of [Mistral-Large-Instruct-2407](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407)
|
| 12 |
|
| 13 |
+
Sizes inspired by [turboderp's exl3 quant of Mistral-Large-Instruct-2411](https://huggingface.co/turboderp/Mistral-Large-Instruct-2411-exl3).
|
| 14 |
|
| 15 |
[1.40 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.4bpw_H4) 20.820 GiB
|
| 16 |
[1.60 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.60bpw_H4) 23.670 GiB
|
|
|
|
| 22 |
[3.50 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/3.50bpw_H6) 50.697 GiB
|
| 23 |
[4.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/4.00bpw_H6) 57.795 GiB
|
| 24 |
[5.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/5.00bpw_H6) 71.975 GiB
|
| 25 |
+
[6.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/6.00bpw_H6) 86.155 GiB
|
| 26 |
+
[8.00 bpw/H8](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/8.00bpw_H8) 114.609 GiB
|