RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8 Text Generation • 24B • Updated Jun 9 • 3.68k • 2
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int4-gs128-asym Text Generation • 4B • Updated Mar 21, 2025 • 6
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int4-gs128-sym Text Generation • 4B • Updated Mar 21, 2025 • 8
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int4-gs128-asym Text Generation • 24B • Updated Mar 21, 2025 • 12
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int4-gs128-sym Text Generation • 24B • Updated Mar 21, 2025 • 12
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoawq-int4-gs128-asym Text Generation • 24B • Updated Mar 21, 2025 • 5
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoawq-int4-gs128-sym Text Generation • 24B • Updated Mar 21, 2025 • 25
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int8-gs128-asym Text Generation • 7B • Updated Mar 27, 2025 • 7
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoround-int8-gs128-sym Text Generation • 7B • Updated Mar 27, 2025 • 5
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int8-gs128-asym Text Generation • 24B • Updated Mar 27, 2025 • 6
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autogptq-int8-gs128-sym Text Generation • 24B • Updated Mar 27, 2025 • 10