EXL3 models
Collection
64 items • Updated • 61
EXL3 quants of Mixtral-8x7B-Instruct-v0.1
2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight / H8
(Couldn't find any GGUF or AWQ versions that still work.)
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for turboderp/Mixtral-8x7B-Instruct-v0.1-exl3
Base model
mistralai/Mixtral-8x7B-v0.1 Finetuned
mistralai/Mixtral-8x7B-Instruct-v0.1