---
license: apache-2.0
base_model:
- Vikhrmodels/Vistral-24B-Instruct
base_model_relation: quantized
pipeline_tag: text-generation
library_name: safetensors
tags:
- exl3
- 4-bit
- 6-bit
- 8-bit
---
## EXL3 quants: [ [H8-4.0BPW](https://huggingface.co/DeathGodlike/Vistral-24B-Instruct_EXL3/tree/H8-4.0BPW) | [H8-6.0BPW](https://huggingface.co/DeathGodlike/Vistral-24B-Instruct_EXL3/tree/H8-6.0BPW) | [H8-8.0BPW](https://huggingface.co/DeathGodlike/Vistral-24B-Instruct_EXL3/tree/H8-8.0BPW) ]

# Original model: [Vistral-24B-Instruct](https://huggingface.co/Vikhrmodels/Vistral-24B-Instruct) by [Vikhrmodels](https://huggingface.co/Vikhrmodels)