---
license: other
license_name: mrl
inference: false
license_link: https://mistral.ai/licenses/MRL-0.1.md
base_model: mistralai/Mistral-Large-Instruct-2407
base_model_relation: quantized
tags:
  - exl3
---
[exllamav3](https://github.com/turboderp-org/exllamav3) quantizations of [Mistral-Large-Instruct-2407](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407)

Sizes inspired by [turboderp's exl3 quant of Mistral-Large-Instruct-2411](https://huggingface.co/turboderp/Mistral-Large-Instruct-2411-exl3) with one notable exception.

[1.40 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.4bpw_H4) 20.820 GiB    
[1.60 bpw/H4](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.60bpw_H4) 23.670 GiB    
[1.80 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/1.80bpw_H5) 26.541 GiB    
[2.00 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.00bpw_H5) 29.389 GiB    
[2.25 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.25bpw_H5) 32.927 GiB    
[2.50 bpw/H5](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/2.50bpw_H5) 36.470 GiB    
[3.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/3.0bpw_H6) 43.616 GiB    
[3.50 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/3.50bpw_H6) 50.697 GiB    
[4.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/4.00bpw_H6) 57.795 GiB    
[5.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/5.00bpw_H6) 71.975 GiB    
[6.00 bpw/H6](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/6.00bpw_H6) 86.155 GiB    
[8.00 bpw/H8](https://huggingface.co/MikeRoz/Mistral-Large-Instruct-2407-exl3/tree/8.00bpw_H8) 114.609 GiB