Instructions to use google/gemma-4-12B-it with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/gemma-4-12B-it with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("google/gemma-4-12B-it") model = AutoModelForMultimodalLM.from_pretrained("google/gemma-4-12B-it") - Notebooks
- Google Colab
- Kaggle
NVFP4 Quant
#22
by berkerdooo - opened
Unofficial nVFP4 quant trained on rtx 5090 , feel free to give feedback!
Hi @berkerdooo -
Thank you so much for taking the time to provide these quantized versions. We truly appreciate your efforts on sharing your nVFP4-quantized Gemma 4 12B IT model with the community.