How to use palmfuture/gemma-4-12B-it-INT4-W4A16 with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("palmfuture/gemma-4-12B-it-INT4-W4A16") model = AutoModelForMultimodalLM.from_pretrained("palmfuture/gemma-4-12B-it-INT4-W4A16", device_map="auto")
