---
language:
- en
library_name: mlx
license: gemma
pipeline_tag: image-text-to-text
base_model: google/gemma-4-12B-it-qat-q4_0-unquantized
tags:
- mlx
- jang
- jang-4m
- qat
- quantized
- apple-silicon
- gemma4
- vision
- audio
---

<p align="center"><img src="./jangq-logo-dark.png" alt="JANGQ AI" width="180"></p>

# JANGQ-AI/gemma-4-12B-it-qat-JANG_4M

JANG_4M MLX affine bundle converted from [google/gemma-4-12B-it-qat-q4_0-unquantized](https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized).

This bundle keeps Gemma 4 bookends and media-sensitive components coherent: token embeddings/output projection, norms, media towers/embedders, and Gemma 4 per-layer embedding/gate/projector tensors are fp16 passthrough; self-attention and MoE router projections are 8-bit affine; decoder MLP/expert bulk is 4-bit affine.

## Bundle

| Field | Value |
|---|---|
| Source | `google/gemma-4-12B-it-qat-q4_0-unquantized` |
| Architecture | `gemma4_unified` / `Gemma4UnifiedForConditionalGeneration` |
| Text layers | 48 |
| Hidden size | 3840 |
| Weight format | `jang_affine` |
| Top-level quantization | bits=8, group_size=32, mode=affine |
| Tier bits | attention=8, router=8, mlp=4, embed=16, per_layer_media=16 |
| Quantized modules | 328 affine bases with `.scales` and `.biases` sidecars |
| Shards | 10 safetensors shards |
| Preserved source modalities | text, vision, audio |
| Verified current vMLX runtime | text-only |

## Modalities

| Modality | Status |
|---|---|
| Text | verified through the vMLX JANG text loader |
| Vision | source config and weights are present and preserved; standard `mlx_vlm` does not yet provide `gemma4_unified` runtime support |
| Audio | `audio_config` and audio embedder weights are present and preserved; standard `mlx_vlm` does not yet provide `gemma4_unified` runtime support |
| Video | No `video_config` is present, so this card does not claim a verified video runtime path. |

Runtime support depends on a Gemma 4 compatible MLX/vMLX loader that understands `config.json` `quantization` overrides, `jang_config.json`, and Gemma 4 processor/chat-template files. The current verified path is text-only through vMLX's JANG loader; vision/audio require a real `gemma4_unified` VLM implementation.

## Runtime Metadata

- `config.json` has source-derived `has_vision`, `has_audio`, `has_video`, `modalities`, and `capabilities`.
- `tokenizer_config.json` includes `bos_token_id`, `eos_token_id`, `pad_token_id`, and the patched Gemma 4 chat template.
- `processor_config.json` is preserved for Gemma 4 multimodal processing.
- MTP/speculative drafter weights are not present in the source checkpoint; metadata is `mtp: none` / `mtp_policy: none`.