unsloth/gemma-4-12B-it-qat-GGUF
Any-to-Any • 12B • Updated • 439k • 284
Gemma 4 QAT
Gemma 4 QAT (Quantization-Aware Training) for 3x less memory use and near original accuracy.
Note GGUFs to run:
-
unsloth/gemma-4-26B-A4B-it-qat-GGUF
Image-Text-to-Text • 25B • Updated • 756k • 213 -
unsloth/gemma-4-31B-it-qat-GGUF
Image-Text-to-Text • 31B • Updated • 267k • 113 -
unsloth/gemma-4-E4B-it-qat-GGUF
Any-to-Any • 7B • Updated • 190k • 92 -
unsloth/gemma-4-E2B-it-qat-GGUF
Any-to-Any • 5B • Updated • 116k • 50 -
unsloth/gemma-4-E2B-it-qat-mobile-GGUF
Any-to-Any • 5B • Updated • 45.3k • 22 -
unsloth/gemma-4-E4B-it-qat-mobile-GGUF
Any-to-Any • 7B • Updated • 48.4k • 22 -
unsloth/gemma-4-26B-A4B-it-qat-q4_0-unquantized
Image-Text-to-Text • 27B • Updated • 1.2k • 3
unsloth/gemma-4-E2B-it-qat-q4_0-unquantized
Any-to-Any • 5B • Updated • 1.94k • 3Note BF16 Safetensor:
-
unsloth/gemma-4-E4B-it-qat-q4_0-unquantized
Any-to-Any • 8B • Updated • 1.82k • 3 -
unsloth/gemma-4-12B-it-qat-q4_0-unquantized
Any-to-Any • 12B • Updated • 6.36k • 9 -
unsloth/gemma-4-31B-it-qat-q4_0-unquantized
Image-Text-to-Text • 33B • Updated • 768 • 4 -
unsloth/gemma-4-E2B-it-qat-mobile
Any-to-Any • 2B • Updated • 445 • 4 -
unsloth/gemma-4-E4B-it-qat-mobile
Any-to-Any • 3B • Updated • 456 • 4 -
unsloth/gemma-4-E4B-it-qat-w4a16
Any-to-Any • 9B • Updated • 3.3k • 3 -
unsloth/gemma-4-E2B-it-qat-w4a16
Any-to-Any • 6B • Updated • 987 • 3