zerofata

/

G4-MeroMero-26B-A4B

like 113

Hi, really liked your 26B-A4B and 31B finetunes of Gemma4. Recently google has released QAT(Quantization Aware Training) versions of Gemma 4 series that are basically 4bit. Which, in theory, must mean lower quants having better output than their non-QAT siblings