Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,128 @@
+---
+license: gemma
+base_model: google/gemma-4-12B-it
+library_name: mlx
+pipeline_tag: image-text-to-text
+thumbnail: dealign_mascot.png
+tags:
+- mlx
+- apple-silicon
+- abliterated
+- uncensored
+- crack
+- vision
+- audio
+- omni-modal
+- gemma4
+- gemma
+- google
+- harmbench
+- mmlu
+- jang_4m
+---
+
+<!-- vmlx-banner -->
+<div align="center">
+<a href="https://vmlx.net">
+<img src="vmlx-banner.png" width="280" />
+<br/>
+<strong>Built for vMLX</strong> — the MLX inferencer with KV-cache quantization, prefix-cache reuse, agentic tool calling, and hybrid sliding+full attention support.
+<br/>
+<sub>Free for macOS · <strong>vmlx.net</strong></sub>
+</a>
+</div>
+
+---
+
+<div align="center">
+
+<img src="dealign_mascot.png" width="128" />
+
+# Gemma 4 12B-it — JANG_4M CRACK
+
+**CRACK abliterated** · **JANG mixed-precision (8-bit attention, 4-bit MLP)** · Omni-modal (text + image + audio + video) · 9.6 GB
+
+<a href="https://ko-fi.com/dealignai"><img src="https://img.shields.io/badge/Ko--fi-Support_Development-FF5E5B?logo=ko-fi&logoColor=white&style=for-the-badge" alt="Ko-fi"></a>
+
+</div>
+
+---
+
+## What Is This?
+
+This is [Gemma 4 12B-it](https://huggingface.co/google/gemma-4-12B-it) by Google — a unified omni-modal language model (text + image + audio + video, hybrid sliding/full attention, 48 layers, 128k context) that has been:
+
+1. **CRACK abliterated** — safety refusal removed at the weight level. The model now complies across all task categories instead of refusing, while keeping its knowledge, reasoning, and multimodal capabilities intact.
+2. **JANG mixed-precision (8-bit attention, 4-bit MLP) quantized** for MLX on Apple Silicon — 9.6 GB.
+
+## Results
+
+Evaluated through the Osaurus runtime on a Mac Studio M3 Ultra. Compliance graded via HarmBench-text refusal classifier; MMLU via logit-mode argmax over A/B/C/D token logits (matched on both base and CRACK with identical chat-template rendering — no answer truncated).
+
+### HarmBench compliance (70 prompts · 10 per category)
+
+| Category | CRACK ASR |
+|---|---:|
+| Chemical / biological | **10 / 10** (100%) |
+| Copyright | **10 / 10** (100%) |
+| Cybercrime / intrusion | **10 / 10** (100%) |
+| Harassment / bullying | **10 / 10** (100%) |
+| Illegal | **10 / 10** (100%) |
+| Misinformation / disinformation | **10 / 10** (100%) |
+| General harmful | **10 / 10** (100%) |
+| **Overall** | **70 / 70 (100%)** |
+
+### MMLU-228 (57-subject, 4 q per subject)
+
+| Subject area | base | CRACK | Δ |
+|---|---:|---:|---:|
+| **Overall** | 67.1% | **69.3%** | +2.2pp |
+| STEM | 68.1% | 66.7% | -1.4pp |
+| Humanities | 57.7% | 63.5% | +5.8pp |
+| Social Sciences | 75.0% | 75.0% | +0.0pp |
+| Other (medicine, business, …) | 67.9% | 73.2% | +5.3pp |
+
+## Features
+
+- **Omni-modal**: native text + image + audio + video inputs (Gemma 4's unified early-fusion encoder-free architecture)
+- **128k context** with hybrid sliding-window + full-attention layers
+- **Reasoning** via the Gemma 4 channel-marker format (`<|channel>thought ... <channel|>`)
+- **48 transformer layers**, hidden size 3840
+
+## Usage
+
+Run with the **Osaurus** runtime (recommended — supports the `gemma4_unified` architecture directly):
+
+```python
+# OpenAI-compatible chat completion
+# POST /v1/chat/completions
+{
+  "model": "dealignai/Gemma-4-12B-it-JANG_4M-CRACK",
+  "messages": [{"role": "user", "content": "..."}],
+  "temperature": 0.0
+}
+```
+
+Google recommends `temperature=1.0, top_p=0.95, top_k=64` for general use.
+
+## About CRACK
+
+**CRACK** (Controlled Refusal Ablation via Calibrated Knockouts) removes safety-refusal behavior at the weight level so the model complies with all task categories while preserving reasoning quality, factual knowledge, multimodal capability, and coherence.
+
+## Support dealignai
+
+All models are built from original research and released free.
+
+**[Support us on Ko-fi](https://ko-fi.com/dealignai)** — membership gets early access and extras.
+
+[Ko-fi](https://ko-fi.com/dealignai) · [X @dealignai](https://x.com/dealignai) · [dealign.ai](https://dealign.ai)
+
+See our research: [Safety Generalization in Frontier Models](https://dealign.ai/quantsteer.html)
+
+<div align="center"><img src="dealign_logo.png" alt="dealign.ai" width="200"/></div>
+
+---
+
+## Disclaimer
+
+This model has had its safety-refusal behavior removed for research purposes. It will follow instructions across all categories without refusing. You are solely responsible for how you use it and for complying with all applicable laws. Published for AI-safety research and authorized security testing.

chat_template.jinja

@@ -0,0 +1,363 @@
+{%- macro format_parameters(properties, required, filter_keys=false) -%}
+    {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}
+    {%- set ns = namespace(found_first=false) -%}
+    {%- for key, value in properties | dictsort -%}
+        {%- set add_comma = false -%}
+        {%- if not filter_keys or key not in standard_keys -%}
+            {%- if ns.found_first %},{% endif -%}
+            {%- set ns.found_first = true -%}
+            {{ key }}:{
+            {%- if value['description'] -%}
+                description:<|"|>{{ value['description'] }}<|"|>
+                {%- set add_comma = true -%}
+            {%- endif -%}
+            {%- if value['type'] | upper == 'STRING' -%}
+                {%- if value['enum'] -%}
+                    {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}
+                    enum:{{ format_argument(value['enum']) }}
+                {%- endif -%}
+            {%- elif value['type'] | upper == 'ARRAY' -%}
+                {%- if value['items'] is mapping and value['items'] -%}
+                    {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}
+                    items:{
+                    {%- set ns_items = namespace(found_first=false) -%}
+                    {%- for item_key, item_value in value['items'] | dictsort -%}
+                        {%- if item_value is not none -%}
+                            {%- if ns_items.found_first %},{% endif -%}
+                            {%- set ns_items.found_first = true -%}
+                            {%- if item_key == 'properties' -%}
+                                properties:{
+                                {%- if item_value is mapping -%}
+                                    {{- format_parameters(item_value, value['items']['required'] | default([])) -}}
+                                {%- endif -%}
+                                }
+                            {%- elif item_key == 'required' -%}
+                                required:[
+                                {%- for req_item in item_value -%}
+                                    <|"|>{{- req_item -}}<|"|>
+                                    {%- if not loop.last %},{% endif -%}
+                                {%- endfor -%}
+                                ]
+                            {%- elif item_key == 'type' -%}
+                                {%- if item_value is string -%}
+                                    type:{{ format_argument(item_value | upper) }}
+                                {%- else -%}
+                                    type:{{ format_argument(item_value | map('upper') | list) }}
+                                {%- endif -%}
+                            {%- else -%}
+                                {{ item_key }}:{{ format_argument(item_value) }}
+                            {%- endif -%}
+                        {%- endif -%}
+                    {%- endfor -%}
+                    }
+                {%- endif -%}
+            {%- endif -%}
+            {%- if value['nullable'] %}
+                {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}
+                nullable:true
+            {%- endif -%}
+            {%- if value['type'] | upper == 'OBJECT' -%}
+                {%- if value['properties'] is defined and value['properties'] is mapping -%}
+                    {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}
+                    properties:{
+                    {{- format_parameters(value['properties'], value['required'] | default([])) -}}
+                    }
+                {%- elif value is mapping -%}
+                    {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}
+                    properties:{
+                    {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}
+                    }
+                {%- endif -%}
+                {%- if value['required'] -%}
+                    {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}
+                    required:[
+                    {%- for item in value['required'] | default([]) -%}
+                        <|"|>{{- item -}}<|"|>
+                        {%- if not loop.last %},{% endif -%}
+                    {%- endfor -%}
+                    ]
+                {%- endif -%}
+            {%- endif -%}
+            {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}
+            type:<|"|>{{ value['type'] | upper }}<|"|>}
+        {%- endif -%}
+    {%- endfor -%}
+{%- endmacro -%}
+{%- macro format_function_declaration(tool_data) -%}
+    declaration:{{- tool_data['function']['name'] -}}{description:<|"|>{{- tool_data['function']['description'] -}}<|"|>
+    {%- set params = tool_data['function']['parameters'] -%}
+    {%- if params -%}
+        ,parameters:{
+        {%- if params['properties'] -%}
+            properties:{ {{- format_parameters(params['properties'], params['required']) -}} },
+        {%- endif -%}
+        {%- if params['required'] -%}
+            required:[
+            {%- for item in params['required'] -%}
+                <|"|>{{- item -}}<|"|>
+                {{- ',' if not loop.last -}}
+            {%- endfor -%}
+            ],
+        {%- endif -%}
+        {%- if params['type'] -%}
+            type:<|"|>{{- params['type'] | upper -}}<|"|>}
+        {%- endif -%}
+    {%- endif -%}
+    {%- if 'response' in tool_data['function'] -%}
+        {%- set response_declaration = tool_data['function']['response'] -%}
+        ,response:{
+        {%- if response_declaration['description'] -%}
+            description:<|"|>{{- response_declaration['description'] -}}<|"|>,
+        {%- endif -%}
+        {%- if response_declaration['type'] | upper == 'OBJECT' -%}
+            type:<|"|>{{- response_declaration['type'] | upper -}}<|"|>}
+        {%- endif -%}
+    {%- endif -%}
+    }
+{%- endmacro -%}
+{%- macro format_argument(argument, escape_keys=True) -%}
+    {%- if argument is string -%}
+        {{- '<|"|>' + argument + '<|"|>' -}}
+    {%- elif argument is boolean -%}
+        {{- 'true' if argument else 'false' -}}
+    {%- elif argument is mapping -%}
+        {{- '{' -}}
+        {%- set ns = namespace(found_first=false) -%}
+        {%- for key, value in argument | dictsort -%}
+            {%- if ns.found_first %},{% endif -%}
+            {%- set ns.found_first = true -%}
+            {%- if escape_keys -%}
+                {{- '<|"|>' + key + '<|"|>' -}}
+            {%- else -%}
+                {{- key -}}
+            {%- endif -%}
+            :{{- format_argument(value, escape_keys=escape_keys) -}}
+        {%- endfor -%}
+        {{- '}' -}}
+    {%- elif argument is sequence -%}
+        {{- '[' -}}
+        {%- for item in argument -%}
+            {{- format_argument(item, escape_keys=escape_keys) -}}
+            {%- if not loop.last %},{% endif -%}
+        {%- endfor -%}
+        {{- ']' -}}
+    {%- else -%}
+        {{- argument -}}
+    {%- endif -%}
+{%- endmacro -%}
+{%- macro strip_thinking(text) -%}
+    {%- set ns = namespace(result='') -%}
+    {%- for part in text.split('<channel|>') -%}
+        {%- if '<|channel>' in part -%}
+            {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}
+        {%- else -%}
+            {%- set ns.result = ns.result + part -%}
+        {%- endif -%}
+    {%- endfor -%}
+    {{- ns.result | trim -}}
+{%- endmacro -%}
+
+{%- macro format_tool_response_block(tool_name, response) -%}
+    {{- '<|tool_response>' -}}
+    {%- if response is mapping -%}
+        {{- 'response:' + tool_name + '{' -}}
+        {%- for key, value in response | dictsort -%}
+            {{- key -}}:{{- format_argument(value, escape_keys=False) -}}
+            {%- if not loop.last %},{% endif -%}
+        {%- endfor -%}
+        {{- '}' -}}
+    {%- else -%}
+        {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}
+    {%- endif -%}
+    {{- '<tool_response|>' -}}
+{%- endmacro -%}
+
+{%- set ns = namespace(prev_message_type=None) -%}
+{%- set loop_messages = messages -%}
+{{- bos_token -}}
+{#- Handle System/Tool Definitions Block -#}
+{%- if (enable_thinking is defined and enable_thinking) or tools or messages[0]['role'] in ['system', 'developer'] -%}
+    {{- '<|turn>system\n' -}}
+    {#- Inject Thinking token at the very top of the FIRST system turn -#}
+    {%- if enable_thinking is defined and enable_thinking -%}
+        {{- '<|think|>\n' -}}
+        {%- set ns.prev_message_type = 'think' -%}
+    {%- endif -%}
+    {%- if messages[0]['role'] in ['system', 'developer'] -%}
+        {%- if messages[0]['content'] is string -%}
+            {{- messages[0]['content'] | trim -}}
+        {%- elif messages[0]['content'] is sequence -%}
+            {%- for item in messages[0]['content'] -%}
+                {{- item['text'] | trim + ' '-}}
+            {%- endfor -%}
+        {%- endif -%}
+        {%- set loop_messages = messages[1:] -%}
+    {%- endif -%}
+    {%- if tools -%}
+        {%- for tool in tools %}
+            {{- '<|tool>' -}}
+            {{- format_function_declaration(tool) | trim -}}
+            {{- '<tool|>' -}}
+        {%- endfor %}
+        {%- set ns.prev_message_type = 'tool' -%}
+        {%- if tool_choice is defined and ((tool_choice is string and tool_choice == 'required') or (tool_choice is mapping and tool_choice.get('type') == 'required')) -%}
+            {{- '\nTool use is REQUIRED for this turn: you must call exactly one of the declared tools. Output only the tool call, and copy every argument value verbatim \u2014 character for character, preserving punctuation and newlines, with no added or removed whitespace.' -}}
+        {%- endif -%}
+    {%- endif -%}
+    {{- '<turn|>\n' -}}
+{%- endif %}
+
+{#- Pre-scan: find last user message index for reasoning guard -#}
+{%- set ns_turn = namespace(last_user_idx=-1) -%}
+{%- for i in range(loop_messages | length) -%}
+    {%- if loop_messages[i]['role'] == 'user' -%}
+        {%- set ns_turn.last_user_idx = i -%}
+    {%- endif -%}
+{%- endfor -%}
+
+{#- Loop through messages -#}
+{%- for message in loop_messages -%}
+    {%- if message['role'] != 'tool' -%}
+    {%- set ns.prev_message_type = None -%}
+    {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}
+    {#- Detect continuation: suppress duplicate <|turn>model when previous non-tool message was also assistant -#}
+    {%- set prev_nt = namespace(role=None, found=false) -%}
+    {%- if loop.index0 > 0 -%}
+        {%- for j in range(loop.index0 - 1, -1, -1) -%}
+            {%- if not prev_nt.found -%}
+                {%- if loop_messages[j]['role'] != 'tool' -%}
+                    {%- set prev_nt.role = loop_messages[j]['role'] -%}
+                    {%- set prev_nt.found = true -%}
+                {%- endif -%}
+            {%- endif -%}
+        {%- endfor -%}
+    {%- endif -%}
+    {%- set continue_same_model_turn = (role == 'model' and prev_nt.role == 'assistant') -%}
+    {%- if not continue_same_model_turn -%}
+        {{- '<|turn>' + role + '\n' }}
+    {%- endif -%}
+
+    {#- Render reasoning/reasoning_content as thinking channel -#}
+    {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}
+    {%- if thinking_text and loop.index0 > ns_turn.last_user_idx and message.get('tool_calls') -%}
+        {{- '<|channel>thought\n' + thinking_text + '\n<channel|>' -}}
+    {%- endif -%}
+
+            {%- if message['tool_calls'] -%}
+                {%- for tool_call in message['tool_calls'] -%}
+                    {%- set function = tool_call['function'] -%}
+                    {{- '<|tool_call>call:' + function['name'] + '{' -}}
+                    {%- if function['arguments'] is mapping -%}
+                        {%- set ns_args = namespace(found_first=false) -%}
+                        {%- for key, value in function['arguments'] | dictsort -%}
+                            {%- if ns_args.found_first %},{% endif -%}
+                            {%- set ns_args.found_first = true -%}
+                            {{- key -}}:{{- format_argument(value, escape_keys=False) -}}
+                        {%- endfor -%}
+                    {%- elif function['arguments'] is string -%}
+                        {{- function['arguments'] -}}
+                    {%- endif -%}
+                    {{- '}<tool_call|>' -}}
+                {%- endfor -%}
+                {%- set ns.prev_message_type = 'tool_call' -%}
+            {%- endif -%}
+
+            {%- set ns_tr_out = namespace(flag=false) -%}
+            {%- if message.get('tool_responses') -%}
+                {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}
+                {%- for tool_response in message['tool_responses'] -%}
+                    {{- format_tool_response_block(tool_response['name'] | default('unknown'), tool_response['response']) -}}
+                    {%- set ns_tr_out.flag = true -%}
+                    {%- set ns.prev_message_type = 'tool_response' -%}
+                {%- endfor -%}
+            {%- elif message.get('tool_calls') -%}
+                {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}
+                {%- set ns_tool_scan = namespace(stopped=false) -%}
+                {%- for k in range(loop.index0 + 1, loop_messages | length) -%}
+                    {%- if ns_tool_scan.stopped -%}
+                    {%- elif loop_messages[k]['role'] != 'tool' -%}
+                        {%- set ns_tool_scan.stopped = true -%}
+                    {%- else -%}
+                        {%- set follow = loop_messages[k] -%}
+                        {#- Resolve tool_call_id to function name -#}
+                        {%- set ns_tname = namespace(name=follow.get('name') | default('unknown')) -%}
+                        {%- for tc in message['tool_calls'] -%}
+                            {%- if tc.get('id') == follow.get('tool_call_id') -%}
+                                {%- set ns_tname.name = tc['function']['name'] -%}
+                            {%- endif -%}
+                        {%- endfor -%}
+                        {#- Handle content as string or content-parts array -#}
+                        {%- set tool_body = follow.get('content') -%}
+                        {%- if tool_body is string -%}
+                            {{- format_tool_response_block(ns_tname.name, tool_body) -}}
+                        {%- elif tool_body is sequence and tool_body is not string -%}
+                            {%- set ns_txt = namespace(s='') -%}
+                            {%- for part in tool_body -%}
+                                {%- if part.get('type') == 'text' -%}
+                                    {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}
+                                {%- endif -%}
+                            {%- endfor -%}
+                            {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}
+                            {%- for part in tool_body -%}
+                                {%- if part.get('type') == 'image' -%}
+                                    {{- '<|image|>' -}}
+                                {%- elif part.get('type') == 'audio' -%}
+                                    {{- '<|audio|>' -}}
+                                {%- elif part.get('type') == 'video' -%}
+                                    {{- '<|video|>' -}}
+                                {%- endif -%}
+                            {%- endfor -%}
+                        {%- else -%}
+                            {{- format_tool_response_block(ns_tname.name, tool_body) -}}
+                        {%- endif -%}
+                        {%- set ns_tr_out.flag = true -%}
+                        {%- set ns.prev_message_type = 'tool_response' -%}
+                    {%- endif -%}
+                {%- endfor -%}
+            {%- endif -%}
+
+            {%- set captured_content -%}
+            {%- if message['content'] is string -%}
+                {%- if role == 'model' -%}
+                    {{- strip_thinking(message['content']) -}}
+                {%- else -%}
+                    {{- message['content'] | trim -}}
+                {%- endif -%}
+            {%- elif message['content'] is sequence -%}
+                {%- for item in message['content'] -%}
+                    {%- if item['type'] == 'text' -%}
+                        {%- if role == 'model' -%}
+                            {{- strip_thinking(item['text']) -}}
+                        {%- else -%}
+                            {{- item['text'] | trim -}}
+                        {%- endif -%}
+                    {%- elif item['type'] == 'image' -%}
+                        {{- '<|image|>' -}}
+                        {%- set ns.prev_message_type = 'image' -%}
+                    {%- elif item['type'] == 'audio' -%}
+                        {{- '<|audio|>' -}}
+                        {%- set ns.prev_message_type = 'audio' -%}
+                    {%- elif item['type'] == 'video' -%}
+                        {{- '<|video|>' -}}
+                        {%- set ns.prev_message_type = 'video' -%}
+                    {%- endif -%}
+                {%- endfor -%}
+            {%- endif -%}
+            {%- endset -%}
+
+            {{- captured_content -}}
+            {%- set has_content = captured_content | trim | length > 0 -%}
+
+        {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}
+            {{- '<|tool_response>' -}}
+        {%- elif not (ns_tr_out.flag and not has_content) -%}
+            {{- '<turn|>\n' -}}
+        {%- endif -%}
+    {%- endif -%}
+{%- endfor -%}
+
+{%- if add_generation_prompt -%}
+    {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}
+        {{- '<|turn>model\n' -}}
+    {%- endif -%}
+{%- endif -%}

config.json

@@ -0,0 +1,909 @@
+{
+  "architectures": [
+    "Gemma4UnifiedForConditionalGeneration"
+  ],
+  "audio_config": {
+    "_name_or_path": "",
+    "architectures": null,
+    "audio_embed_dim": 640,
+    "audio_samples_per_token": 640,
+    "chunk_size_feed_forward": 0,
+    "dtype": null,
+    "hidden_size": 640,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "initializer_range": 0.02,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "model_type": "gemma4_unified_audio",
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_proj_dims": 640,
+    "problem_type": null,
+    "return_dict": true,
+    "rms_norm_eps": 1e-06
+  },
+  "audio_token_id": 258881,
+  "boa_token_id": 256000,
+  "boi_token_id": 255999,
+  "dtype": "bfloat16",
+  "eoa_token_index": 258883,
+  "eoi_token_id": 258882,
+  "eos_token_id": [
+    1,
+    106
+  ],
+  "image_token_id": 258880,
+  "initializer_range": 0.02,
+  "model_type": "gemma4_unified",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attention_k_eq_v": true,
+    "bos_token_id": 2,
+    "enable_moe_block": false,
+    "eos_token_id": 1,
+    "final_logit_softcapping": 30.0,
+    "global_head_dim": 512,
+    "head_dim": 256,
+    "hidden_activation": "gelu_pytorch_tanh",
+    "hidden_size": 3840,
+    "hidden_size_per_layer_input": 0,
+    "initializer_range": 0.02,
+    "intermediate_size": 15360,
+    "layer_types": [
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "sliding_attention",
+      "full_attention"
+    ],
+    "max_position_embeddings": 131072,
+    "model_type": "gemma4_unified_text",
+    "moe_intermediate_size": null,
+    "num_attention_heads": 16,
+    "num_experts": null,
+    "num_global_key_value_heads": 1,
+    "num_hidden_layers": 48,
+    "num_key_value_heads": 8,
+    "num_kv_shared_layers": 0,
+    "pad_token_id": 0,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "full_attention": {
+        "partial_rotary_factor": 0.25,
+        "rope_theta": 1000000.0,
+        "rope_type": "proportional"
+      },
+      "sliding_attention": {
+        "rope_theta": 10000.0,
+        "rope_type": "default"
+      }
+    },
+    "sliding_window": 1024,
+    "tie_word_embeddings": true,
+    "top_k_experts": null,
+    "use_bidirectional_attention": "vision",
+    "use_cache": true,
+    "use_double_wide_mlp": false,
+    "vocab_size": 262144,
+    "vocab_size_per_layer_input": 262144
+  },
+  "tie_word_embeddings": true,
+  "transformers_version": "5.10.0.dev0",
+  "video_token_id": 258884,
+  "vision_config": {
+    "_name_or_path": "",
+    "architectures": null,
+    "chunk_size_feed_forward": 0,
+    "dtype": null,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "initializer_range": 0.02,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "mm_embed_dim": 3840,
+    "mm_posemb_size": 1120,
+    "model_patch_size": 48,
+    "model_type": "gemma4_unified_vision",
+    "num_soft_tokens": 280,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_proj_dims": 3840,
+    "patch_size": 16,
+    "pooling_kernel_size": 3,
+    "problem_type": null,
+    "return_dict": true,
+    "rms_norm_eps": 1e-06
+  },
+  "weight_format": "jang_affine",
+  "quantization": {
+    "group_size": 32,
+    "bits": 8,
+    "mode": "affine",
+    "tied_embedding": "fp16_passthrough",
+    "language_model.model.layers.0.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.0.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.0.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.1.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.1.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.1.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.10.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.10.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.10.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.11.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.11.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.11.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.12.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.12.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.12.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.13.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.13.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.13.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.14.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.14.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.14.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.15.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.15.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.15.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.16.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.16.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.16.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.17.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.17.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.17.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.18.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.18.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.18.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.19.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.19.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.19.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.2.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.2.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.2.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.20.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.20.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.20.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.21.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.21.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.21.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.22.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.22.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.22.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.23.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.23.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.23.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.24.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.24.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.24.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.25.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.25.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.25.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.26.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.26.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.26.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.27.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.27.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.27.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.28.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.28.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.28.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.29.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.29.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.29.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.3.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.3.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.3.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.30.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.30.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.30.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.31.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.31.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.31.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.32.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.32.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.32.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.33.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.33.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.33.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.34.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.34.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.34.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.35.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.35.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.35.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.36.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.36.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.36.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.37.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.37.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.37.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.38.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.38.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.38.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.39.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.39.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.39.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.4.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.4.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.4.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.40.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.40.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.40.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.41.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.41.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.41.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.42.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.42.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.42.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.43.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.43.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.43.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.44.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.44.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.44.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.45.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.45.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.45.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.46.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.46.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.46.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.47.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.47.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.47.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.5.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.5.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.5.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.6.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.6.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.6.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.7.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.7.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.7.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.8.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.8.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.8.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.9.mlp.down_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.9.mlp.gate_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    },
+    "language_model.model.layers.9.mlp.up_proj": {
+      "group_size": 32,
+      "bits": 4,
+      "mode": "affine"
+    }
+  },
+  "capabilities": {
+    "reasoning_parser": "gemma4",
+    "tool_parser": "gemma4",
+    "think_in_template": false,
+    "supports_tools": true,
+    "supports_thinking": true,
+    "family": "gemma4",
+    "modality": "vision",
+    "cache_type": "kv"
+  }
+}

generation_config.json

@@ -0,0 +1,18 @@
+{
+  "bos_token_id": 2,
+  "do_sample": true,
+  "eos_token_id": [
+    1,
+    106,
+    50
+  ],
+  "pad_token_id": 0,
+  "suppress_tokens": [
+    258883,
+    258882
+  ],
+  "temperature": 1.0,
+  "top_k": 64,
+  "top_p": 0.95,
+  "transformers_version": "5.10.0.dev0"
+}

jang_config.json

@@ -0,0 +1,55 @@
+{
+  "version": 2,
+  "weight_format": "jang_affine",
+  "profile": "JANG_4M",
+  "source_model": {
+    "name": "gemma-4-12B-it",
+    "architecture": "gemma4_unified_text"
+  },
+  "has_vision": true,
+  "has_audio": true,
+  "quantization": {
+    "method": "jang_affine",
+    "quantization_backend": "mx.quantize",
+    "mode": "affine",
+    "group_size": 32,
+    "tier_bits": {
+      "attention": 8,
+      "mlp": 4,
+      "embed": 16
+    },
+    "tied_embedding": "fp16_passthrough",
+    "norm_convention": "gemma4_scale_shift_zero",
+    "multimodal": "fp16_passthrough_embedders_early_fusion",
+    "mtp_policy": "none",
+    "per_module_override_count": 144,
+    "passthrough_tensor_count": 349
+  },
+  "runtime": {
+    "total_weight_bytes": 10135442880,
+    "total_weight_gb": 9.44,
+    "attention": "hybrid_swa_full_5to1",
+    "sliding_window": 1024,
+    "attention_k_eq_v_on_full_layers": true,
+    "full_attention_layers": [
+      5,
+      11,
+      17,
+      23,
+      29,
+      35,
+      41,
+      47
+    ]
+  },
+  "capabilities": {
+    "reasoning_parser": "gemma4",
+    "tool_parser": "gemma4",
+    "think_in_template": false,
+    "supports_tools": true,
+    "supports_thinking": true,
+    "family": "gemma4",
+    "modality": "vision",
+    "cache_type": "kv"
+  }
+}

model-00001-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:951a2a2c026b9810575744a815cdf33dde57a1547ecff8e46d467745fa286555
+size 2047672664

model-00002-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:437a4827c3de3f50ba5017985d48b629ac61e65871ebe933c702347facc9e1fd
+size 1001192692

model-00003-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:67277789451bf8b1699707a3073d62e8c63977797eabd2c9cedc6c1d946ff94d
+size 1002176044

model-00004-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d727ecffda370546fece49d0b6a327e66f941423014c16dc6a289d3e8d5f2d80
+size 1010040320

model-00005-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8158819add511610ccfc4631c625f80f63fa9445bb0b3193ebb9182c6341b681
+size 1013972490

model-00006-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:78912bfd14bfd2eb3dbc0f5717222aa63fe7ec51ff7872aea57c1e49c88f276e
+size 1014955699

model-00007-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28700ff2796fa827ac8bbf2ec51cce76d98c9ee60c4179353ae6b690e652c04a
+size 1013734310

model-00008-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f1bbbe31ed9fd14f27717a8214598e2baa235e456fe3228bcc2fee7aa5bf2674
+size 1002176052

model-00009-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7b3eb166f2824e2fba6b8f830078b9103526d230e854f01c3ee8e62f406db43c
+size 1045683690

model-00010-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cda6679df16fa313565c96cd1528a56a989a292a4436b141d464e3a518a15e99
+size 17262256

processor_config.json

@@ -0,0 +1,62 @@
+{
+  "audio_ms_per_token": 40,
+  "audio_seq_length": 750,
+  "feature_extractor": {
+    "audio_samples_per_token": 640,
+    "feature_extractor_type": "Gemma4UnifiedAudioFeatureExtractor",
+    "feature_size": 640,
+    "padding_side": "right",
+    "padding_value": 0.0,
+    "return_attention_mask": true,
+    "sampling_rate": 16000
+  },
+  "image_processor": {
+    "do_convert_rgb": true,
+    "do_normalize": false,
+    "do_rescale": true,
+    "do_resize": true,
+    "image_mean": [
+      0.0,
+      0.0,
+      0.0
+    ],
+    "image_processor_type": "Gemma4UnifiedImageProcessor",
+    "image_std": [
+      1.0,
+      1.0,
+      1.0
+    ],
+    "max_soft_tokens": 280,
+    "patch_size": 16,
+    "pooling_kernel_size": 3,
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098
+  },
+  "image_seq_length": 280,
+  "processor_class": "Gemma4UnifiedProcessor",
+  "video_processor": {
+    "do_convert_rgb": true,
+    "do_normalize": true,
+    "do_rescale": true,
+    "do_resize": true,
+    "do_sample_frames": true,
+    "image_mean": [
+      0.0,
+      0.0,
+      0.0
+    ],
+    "image_std": [
+      1.0,
+      1.0,
+      1.0
+    ],
+    "max_soft_tokens": 70,
+    "num_frames": 32,
+    "patch_size": 16,
+    "pooling_kernel_size": 3,
+    "resample": 3,
+    "rescale_factor": 0.00392156862745098,
+    "return_metadata": false,
+    "video_processor_type": "Gemma4UnifiedVideoProcessor"
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc8d3a0ce36466ccc1278bf987df5f71db1719b9ca6b4118264f45cb627bfe0f
+size 32169626

tokenizer_config.json

@@ -0,0 +1,75 @@
+{
+  "audio_token": "<|audio|>",
+  "backend": "tokenizers",
+  "boa_token": "<|audio>",
+  "boi_token": "<|image>",
+  "bos_token": "<bos>",
+  "eoa_token": "<audio|>",
+  "eoc_token": "<channel|>",
+  "eoi_token": "<image|>",
+  "eos_token": "<eos>",
+  "eot_token": "<turn|>",
+  "escape_token": "<|\"|>",
+  "etc_token": "<tool_call|>",
+  "etd_token": "<tool|>",
+  "etr_token": "<tool_response|>",
+  "extra_special_tokens": [
+    "<|video|>"
+  ],
+  "image_token": "<|image|>",
+  "mask_token": "<mask>",
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "padding_side": "left",
+  "processor_class": "Gemma4UnifiedProcessor",
+  "response_schema": {
+    "properties": {
+      "content": {
+        "type": "string"
+      },
+      "role": {
+        "const": "assistant"
+      },
+      "thinking": {
+        "type": "string"
+      },
+      "tool_calls": {
+        "items": {
+          "properties": {
+            "function": {
+              "properties": {
+                "arguments": {
+                  "additionalProperties": {},
+                  "type": "object",
+                  "x-parser": "gemma4-tool-call"
+                },
+                "name": {
+                  "type": "string"
+                }
+              },
+              "type": "object",
+              "x-regex": "call\\:(?P<name>\\w+)(?P<arguments>\\{.*\\})"
+            },
+            "type": {
+              "const": "function"
+            }
+          },
+          "type": "object"
+        },
+        "type": "array",
+        "x-regex-iterator": "<\\|tool_call>(.*?)<tool_call\\|>"
+      }
+    },
+    "type": "object",
+    "x-regex": "(\\<\\|channel\\>thought\\n(?P<thinking>.*?)\\<channel\\|\\>)?(?P<tool_calls>\\<\\|tool_call\\>.*\\<tool_call\\|\\>)?(?P<content>(?:(?!\\<turn\\|\\>)(?!\\<\\|tool_response\\>).)+)?(?:\\<turn\\|\\>|\\<\\|tool_response\\>)?"
+  },
+  "soc_token": "<|channel>",
+  "sot_token": "<|turn>",
+  "stc_token": "<|tool_call>",
+  "std_token": "<|tool>",
+  "str_token": "<|tool_response>",
+  "think_token": "<|think|>",
+  "tokenizer_class": "GemmaTokenizer",
+  "unk_token": "<unk>",
+  "chat_template": "{%- macro format_parameters(properties, required, filter_keys=false) -%}\n    {%- set standard_keys = ['description', 'type', 'properties', 'required', 'nullable'] -%}\n    {%- set ns = namespace(found_first=false) -%}\n    {%- for key, value in properties | dictsort -%}\n        {%- set add_comma = false -%}\n        {%- if not filter_keys or key not in standard_keys -%}\n            {%- if ns.found_first %},{% endif -%}\n            {%- set ns.found_first = true -%}\n            {{ key }}:{\n            {%- if value['description'] -%}\n                description:<|\"|>{{ value['description'] }}<|\"|>\n                {%- set add_comma = true -%}\n            {%- endif -%}\n            {%- if value['type'] | upper == 'STRING' -%}\n                {%- if value['enum'] -%}\n                    {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n                    enum:{{ format_argument(value['enum']) }}\n                {%- endif -%}\n            {%- elif value['type'] | upper == 'ARRAY' -%}\n                {%- if value['items'] is mapping and value['items'] -%}\n                    {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n                    items:{\n                    {%- set ns_items = namespace(found_first=false) -%}\n                    {%- for item_key, item_value in value['items'] | dictsort -%}\n                        {%- if item_value is not none -%}\n                            {%- if ns_items.found_first %},{% endif -%}\n                            {%- set ns_items.found_first = true -%}\n                            {%- if item_key == 'properties' -%}\n                                properties:{\n                                {%- if item_value is mapping -%}\n                                    {{- format_parameters(item_value, value['items']['required'] | default([])) -}}\n                                {%- endif -%}\n                                }\n                            {%- elif item_key == 'required' -%}\n                                required:[\n                                {%- for req_item in item_value -%}\n                                    <|\"|>{{- req_item -}}<|\"|>\n                                    {%- if not loop.last %},{% endif -%}\n                                {%- endfor -%}\n                                ]\n                            {%- elif item_key == 'type' -%}\n                                {%- if item_value is string -%}\n                                    type:{{ format_argument(item_value | upper) }}\n                                {%- else -%}\n                                    type:{{ format_argument(item_value | map('upper') | list) }}\n                                {%- endif -%}\n                            {%- else -%}\n                                {{ item_key }}:{{ format_argument(item_value) }}\n                            {%- endif -%}\n                        {%- endif -%}\n                    {%- endfor -%}\n                    }\n                {%- endif -%}\n            {%- endif -%}\n            {%- if value['nullable'] %}\n                {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n                nullable:true\n            {%- endif -%}\n            {%- if value['type'] | upper == 'OBJECT' -%}\n                {%- if value['properties'] is defined and value['properties'] is mapping -%}\n                    {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n                    properties:{\n                    {{- format_parameters(value['properties'], value['required'] | default([])) -}}\n                    }\n                {%- elif value is mapping -%}\n                    {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n                    properties:{\n                    {{- format_parameters(value, value['required'] | default([]), filter_keys=true) -}}\n                    }\n                {%- endif -%}\n                {%- if value['required'] -%}\n                    {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n                    required:[\n                    {%- for item in value['required'] | default([]) -%}\n                        <|\"|>{{- item -}}<|\"|>\n                        {%- if not loop.last %},{% endif -%}\n                    {%- endfor -%}\n                    ]\n                {%- endif -%}\n            {%- endif -%}\n            {%- if add_comma %},{%- else -%} {%- set add_comma = true -%} {% endif -%}\n            type:<|\"|>{{ value['type'] | upper }}<|\"|>}\n        {%- endif -%}\n    {%- endfor -%}\n{%- endmacro -%}\n{%- macro format_function_declaration(tool_data) -%}\n    declaration:{{- tool_data['function']['name'] -}}{description:<|\"|>{{- tool_data['function']['description'] -}}<|\"|>\n    {%- set params = tool_data['function']['parameters'] -%}\n    {%- if params -%}\n        ,parameters:{\n        {%- if params['properties'] -%}\n            properties:{ {{- format_parameters(params['properties'], params['required']) -}} },\n        {%- endif -%}\n        {%- if params['required'] -%}\n            required:[\n            {%- for item in params['required'] -%}\n                <|\"|>{{- item -}}<|\"|>\n                {{- ',' if not loop.last -}}\n            {%- endfor -%}\n            ],\n        {%- endif -%}\n        {%- if params['type'] -%}\n            type:<|\"|>{{- params['type'] | upper -}}<|\"|>}\n        {%- endif -%}\n    {%- endif -%}\n    {%- if 'response' in tool_data['function'] -%}\n        {%- set response_declaration = tool_data['function']['response'] -%}\n        ,response:{\n        {%- if response_declaration['description'] -%}\n            description:<|\"|>{{- response_declaration['description'] -}}<|\"|>,\n        {%- endif -%}\n        {%- if response_declaration['type'] | upper == 'OBJECT' -%}\n            type:<|\"|>{{- response_declaration['type'] | upper -}}<|\"|>}\n        {%- endif -%}\n    {%- endif -%}\n    }\n{%- endmacro -%}\n{%- macro format_argument(argument, escape_keys=True) -%}\n    {%- if argument is string -%}\n        {{- '<|\"|>' + argument + '<|\"|>' -}}\n    {%- elif argument is boolean -%}\n        {{- 'true' if argument else 'false' -}}\n    {%- elif argument is mapping -%}\n        {{- '{' -}}\n        {%- set ns = namespace(found_first=false) -%}\n        {%- for key, value in argument | dictsort -%}\n            {%- if ns.found_first %},{% endif -%}\n            {%- set ns.found_first = true -%}\n            {%- if escape_keys -%}\n                {{- '<|\"|>' + key + '<|\"|>' -}}\n            {%- else -%}\n                {{- key -}}\n            {%- endif -%}\n            :{{- format_argument(value, escape_keys=escape_keys) -}}\n        {%- endfor -%}\n        {{- '}' -}}\n    {%- elif argument is sequence -%}\n        {{- '[' -}}\n        {%- for item in argument -%}\n            {{- format_argument(item, escape_keys=escape_keys) -}}\n            {%- if not loop.last %},{% endif -%}\n        {%- endfor -%}\n        {{- ']' -}}\n    {%- else -%}\n        {{- argument -}}\n    {%- endif -%}\n{%- endmacro -%}\n{%- macro strip_thinking(text) -%}\n    {%- set ns = namespace(result='') -%}\n    {%- for part in text.split('<channel|>') -%}\n        {%- if '<|channel>' in part -%}\n            {%- set ns.result = ns.result + part.split('<|channel>')[0] -%}\n        {%- else -%}\n            {%- set ns.result = ns.result + part -%}\n        {%- endif -%}\n    {%- endfor -%}\n    {{- ns.result | trim -}}\n{%- endmacro -%}\n\n{%- macro format_tool_response_block(tool_name, response) -%}\n    {{- '<|tool_response>' -}}\n    {%- if response is mapping -%}\n        {{- 'response:' + tool_name + '{' -}}\n        {%- for key, value in response | dictsort -%}\n            {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n            {%- if not loop.last %},{% endif -%}\n        {%- endfor -%}\n        {{- '}' -}}\n    {%- else -%}\n        {{- 'response:' + tool_name + '{value:' + format_argument(response, escape_keys=False) + '}' -}}\n    {%- endif -%}\n    {{- '<tool_response|>' -}}\n{%- endmacro -%}\n\n{%- set ns = namespace(prev_message_type=None) -%}\n{%- set loop_messages = messages -%}\n{{- bos_token -}}\n{#- Handle System/Tool Definitions Block -#}\n{%- if (enable_thinking is defined and enable_thinking) or tools or messages[0]['role'] in ['system', 'developer'] -%}\n    {{- '<|turn>system\\n' -}}\n    {#- Inject Thinking token at the very top of the FIRST system turn -#}\n    {%- if enable_thinking is defined and enable_thinking -%}\n        {{- '<|think|>\\n' -}}\n        {%- set ns.prev_message_type = 'think' -%}\n    {%- endif -%}\n    {%- if messages[0]['role'] in ['system', 'developer'] -%}\n        {%- if messages[0]['content'] is string -%}\n            {{- messages[0]['content'] | trim -}}\n        {%- elif messages[0]['content'] is sequence -%}\n            {%- for item in messages[0]['content'] -%}\n                {{- item['text'] | trim + ' '-}}\n            {%- endfor -%}\n        {%- endif -%}\n        {%- set loop_messages = messages[1:] -%}\n    {%- endif -%}\n    {%- if tools -%}\n        {%- for tool in tools %}\n            {{- '<|tool>' -}}\n            {{- format_function_declaration(tool) | trim -}}\n            {{- '<tool|>' -}}\n        {%- endfor %}\n        {%- set ns.prev_message_type = 'tool' -%}\n        {%- if tool_choice is defined and ((tool_choice is string and tool_choice == 'required') or (tool_choice is mapping and tool_choice.get('type') == 'required')) -%}\n            {{- '\\nTool use is REQUIRED for this turn: you must call exactly one of the declared tools. Output only the tool call, and copy every argument value verbatim \\u2014 character for character, preserving punctuation and newlines, with no added or removed whitespace.' -}}\n        {%- endif -%}\n    {%- endif -%}\n    {{- '<turn|>\\n' -}}\n{%- endif %}\n\n{#- Pre-scan: find last user message index for reasoning guard -#}\n{%- set ns_turn = namespace(last_user_idx=-1) -%}\n{%- for i in range(loop_messages | length) -%}\n    {%- if loop_messages[i]['role'] == 'user' -%}\n        {%- set ns_turn.last_user_idx = i -%}\n    {%- endif -%}\n{%- endfor -%}\n\n{#- Loop through messages -#}\n{%- for message in loop_messages -%}\n    {%- if message['role'] != 'tool' -%}\n    {%- set ns.prev_message_type = None -%}\n    {%- set role = 'model' if message['role'] == 'assistant' else message['role'] -%}\n    {#- Detect continuation: suppress duplicate <|turn>model when previous non-tool message was also assistant -#}\n    {%- set prev_nt = namespace(role=None, found=false) -%}\n    {%- if loop.index0 > 0 -%}\n        {%- for j in range(loop.index0 - 1, -1, -1) -%}\n            {%- if not prev_nt.found -%}\n                {%- if loop_messages[j]['role'] != 'tool' -%}\n                    {%- set prev_nt.role = loop_messages[j]['role'] -%}\n                    {%- set prev_nt.found = true -%}\n                {%- endif -%}\n            {%- endif -%}\n        {%- endfor -%}\n    {%- endif -%}\n    {%- set continue_same_model_turn = (role == 'model' and prev_nt.role == 'assistant') -%}\n    {%- if not continue_same_model_turn -%}\n        {{- '<|turn>' + role + '\\n' }}\n    {%- endif -%}\n\n    {#- Render reasoning/reasoning_content as thinking channel -#}\n    {%- set thinking_text = message.get('reasoning') or message.get('reasoning_content') -%}\n    {%- if thinking_text and loop.index0 > ns_turn.last_user_idx and message.get('tool_calls') -%}\n        {{- '<|channel>thought\\n' + thinking_text + '\\n<channel|>' -}}\n    {%- endif -%}\n\n            {%- if message['tool_calls'] -%}\n                {%- for tool_call in message['tool_calls'] -%}\n                    {%- set function = tool_call['function'] -%}\n                    {{- '<|tool_call>call:' + function['name'] + '{' -}}\n                    {%- if function['arguments'] is mapping -%}\n                        {%- set ns_args = namespace(found_first=false) -%}\n                        {%- for key, value in function['arguments'] | dictsort -%}\n                            {%- if ns_args.found_first %},{% endif -%}\n                            {%- set ns_args.found_first = true -%}\n                            {{- key -}}:{{- format_argument(value, escape_keys=False) -}}\n                        {%- endfor -%}\n                    {%- elif function['arguments'] is string -%}\n                        {{- function['arguments'] -}}\n                    {%- endif -%}\n                    {{- '}<tool_call|>' -}}\n                {%- endfor -%}\n                {%- set ns.prev_message_type = 'tool_call' -%}\n            {%- endif -%}\n\n            {%- set ns_tr_out = namespace(flag=false) -%}\n            {%- if message.get('tool_responses') -%}\n                {#- Legacy: tool_responses embedded on the assistant message (Google/Gemma native) -#}\n                {%- for tool_response in message['tool_responses'] -%}\n                    {{- format_tool_response_block(tool_response['name'] | default('unknown'), tool_response['response']) -}}\n                    {%- set ns_tr_out.flag = true -%}\n                    {%- set ns.prev_message_type = 'tool_response' -%}\n                {%- endfor -%}\n            {%- elif message.get('tool_calls') -%}\n                {#- OpenAI Chat Completions: forward-scan consecutive role:tool messages -#}\n                {%- set ns_tool_scan = namespace(stopped=false) -%}\n                {%- for k in range(loop.index0 + 1, loop_messages | length) -%}\n                    {%- if ns_tool_scan.stopped -%}\n                    {%- elif loop_messages[k]['role'] != 'tool' -%}\n                        {%- set ns_tool_scan.stopped = true -%}\n                    {%- else -%}\n                        {%- set follow = loop_messages[k] -%}\n                        {#- Resolve tool_call_id to function name -#}\n                        {%- set ns_tname = namespace(name=follow.get('name') | default('unknown')) -%}\n                        {%- for tc in message['tool_calls'] -%}\n                            {%- if tc.get('id') == follow.get('tool_call_id') -%}\n                                {%- set ns_tname.name = tc['function']['name'] -%}\n                            {%- endif -%}\n                        {%- endfor -%}\n                        {#- Handle content as string or content-parts array -#}\n                        {%- set tool_body = follow.get('content') -%}\n                        {%- if tool_body is string -%}\n                            {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n                        {%- elif tool_body is sequence and tool_body is not string -%}\n                            {%- set ns_txt = namespace(s='') -%}\n                            {%- for part in tool_body -%}\n                                {%- if part.get('type') == 'text' -%}\n                                    {%- set ns_txt.s = ns_txt.s + (part.get('text') | default('')) -%}\n                                {%- endif -%}\n                            {%- endfor -%}\n                            {{- format_tool_response_block(ns_tname.name, ns_txt.s) -}}\n                            {%- for part in tool_body -%}\n                                {%- if part.get('type') == 'image' -%}\n                                    {{- '<|image|>' -}}\n                                {%- elif part.get('type') == 'audio' -%}\n                                    {{- '<|audio|>' -}}\n                                {%- elif part.get('type') == 'video' -%}\n                                    {{- '<|video|>' -}}\n                                {%- endif -%}\n                            {%- endfor -%}\n                        {%- else -%}\n                            {{- format_tool_response_block(ns_tname.name, tool_body) -}}\n                        {%- endif -%}\n                        {%- set ns_tr_out.flag = true -%}\n                        {%- set ns.prev_message_type = 'tool_response' -%}\n                    {%- endif -%}\n                {%- endfor -%}\n            {%- endif -%}\n\n            {%- set captured_content -%}\n            {%- if message['content'] is string -%}\n                {%- if role == 'model' -%}\n                    {{- strip_thinking(message['content']) -}}\n                {%- else -%}\n                    {{- message['content'] | trim -}}\n                {%- endif -%}\n            {%- elif message['content'] is sequence -%}\n                {%- for item in message['content'] -%}\n                    {%- if item['type'] == 'text' -%}\n                        {%- if role == 'model' -%}\n                            {{- strip_thinking(item['text']) -}}\n                        {%- else -%}\n                            {{- item['text'] | trim -}}\n                        {%- endif -%}\n                    {%- elif item['type'] == 'image' -%}\n                        {{- '<|image|>' -}}\n                        {%- set ns.prev_message_type = 'image' -%}\n                    {%- elif item['type'] == 'audio' -%}\n                        {{- '<|audio|>' -}}\n                        {%- set ns.prev_message_type = 'audio' -%}\n                    {%- elif item['type'] == 'video' -%}\n                        {{- '<|video|>' -}}\n                        {%- set ns.prev_message_type = 'video' -%}\n                    {%- endif -%}\n                {%- endfor -%}\n            {%- endif -%}\n            {%- endset -%}\n\n            {{- captured_content -}}\n            {%- set has_content = captured_content | trim | length > 0 -%}\n\n        {%- if ns.prev_message_type == 'tool_call' and not ns_tr_out.flag -%}\n            {{- '<|tool_response>' -}}\n        {%- elif not (ns_tr_out.flag and not has_content) -%}\n            {{- '<turn|>\\n' -}}\n        {%- endif -%}\n    {%- endif -%}\n{%- endfor -%}\n\n{%- if add_generation_prompt -%}\n    {%- if ns.prev_message_type != 'tool_response' and ns.prev_message_type != 'tool_call' -%}\n        {{- '<|turn>model\\n' -}}\n    {%- endif -%}\n{%- endif -%}"
+}