Edit Models filters

Model Tree

google/gemma-4-12B

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

50

Base only

Active filters: google/gemma-4-12B

mavis-ai/Gemma4-12B-MLX-Q8

Image-Text-to-Text • 12B • Updated Jul 1 • 28

LeaderboardModel1/gemma-4-12B-AutoRound-MXFP4-RTN

Text Generation • 3B • Updated Jul 1 • 5

mavis-ai/Gemma4-12B-MLX-Q4

Image-Text-to-Text • 12B • Updated Jul 1 • 40

LeaderboardModel1/gemma-4-12B-AutoRound-W4A16-RTN

Text Generation • 1B • Updated Jul 9 • 461 • 2

ayush1399/gemma-4-12B-it-FP8-block

Any-to-Any • 12B • Updated Jul 16 • 12

ggml-org/gemma-4-12B-GGUF

Any-to-Any • 12B • Updated Jul 16 • 2.18k • 3

majentik/gemma-4-12B-TurboQuant-MLX-3bit

Image-Text-to-Text • 12B • Updated Jul 20 • 43

majentik/gemma-4-12B-TurboQuant-MLX-4bit

Image-Text-to-Text • 12B • Updated Jul 20 • 55 • 2

majentik/gemma-4-12B-TurboQuant-MLX-5bit

Image-Text-to-Text • 12B • Updated Jul 20 • 12

majentik/gemma-4-12B-TurboQuant-MLX-6bit

Image-Text-to-Text • 12B • Updated Jul 20 • 32

majentik/gemma-4-12B-RotorQuant-MLX-8bit

Image-Text-to-Text • 12B • Updated Jul 20 • 34 • 1

majentik/gemma-4-12B-TurboQuant-MLX-MXFP4

Image-Text-to-Text • 12B • Updated Jul 20 • 22

majentik/gemma-4-12B-TurboQuant-MLX-NVFP4

Image-Text-to-Text • 12B • Updated Jul 20 • 28

majentik/gemma-4-12B-RotorQuant-GGUF-Q3_K_M

Text Generation • 12B • Updated Jul 20 • 33

majentik/gemma-4-12B-TurboQuant-GGUF-IQ4_XS

Text Generation • 12B • Updated Jul 20 • 76

majentik/gemma-4-12B-TurboQuant-GGUF-Q4_K_M

Text Generation • 12B • Updated Jul 20 • 149

majentik/gemma-4-12B-TurboQuant-GGUF-Q5_K_M

Text Generation • 12B • Updated Jul 20 • 122

majentik/gemma-4-12B-TurboQuant-GGUF-Q8_0

Text Generation • 12B • Updated Jul 20 • 63

Spiteman/gemma4-12-oQ6e-fp16

Any-to-Any • 3B • Updated Jul 19 • 5

mistrjirka/Gemma-4-12B-PXQ-GGUF

12B • Updated 6 days ago • 4.1k