--- license: other base_model: mistralai/Mistral-Medium-3.5-128B base_model_relation: quantized quantized_by: turboderp tags: - exl3 --- EXL3 quants of [Mistral-Medium-3.5-128B](https://huggingface.co/mistralai/Mistral-Medium-3.5-128B) [2.00 bits per weight](https://huggingface.co/turboderp/Mistral-Medium-3.5-128B-exl3/tree/2.00bpw) [2.25 bits per weight](https://huggingface.co/turboderp/Mistral-Medium-3.5-128B-exl3/tree/2.25bpw) [2.50 bits per weight](https://huggingface.co/turboderp/Mistral-Medium-3.5-128B-exl3/tree/2.50bpw) [3.00 bits per weight](https://huggingface.co/turboderp/Mistral-Medium-3.5-128B-exl3/tree/3.00bpw) [3.50 bits per weight](https://huggingface.co/turboderp/Mistral-Medium-3.5-128B-exl3/tree/3.50bpw) [4.00 bits per weight](https://huggingface.co/turboderp/Mistral-Medium-3.5-128B-exl3/tree/4.00bpw)