Quantize the weights to 4 bits using bitsandbytes from huihui-ai/Huihui-gemma-3n-E4B-it-abliterated

Downloads last month
9
Safetensors
Model size
8B params
Tensor type
F32
BF16
U8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for Qwe1325/Huihui-gemma-3n-E4B-it-abliterated-bnb-4bit

Quantized
(16)
this model