---
base_model: google/gemma-4-12B-it-qat-q4_0-unquantized
base_model_relation: finetune
license: apache-2.0
library_name: transformers
pipeline_tag: image-text-to-text
tags:
  - heretic
  - uncensored
  - decensored
  - abliterated
---

# This is a decensored version of [google/gemma-4-12B-it-qat-q4_0-unquantized](https://huggingface.co/google/gemma-4-12B-it-qat-q4_0-unquantized), made using [Heretic](https://github.com/p-e-w/heretic)

## v1.1 — thinking-mode fix

Gemma 4 is a **thinking** model: its refusal decision forms inside the
chain-of-thought. The first release was abliterated/evaluated with thinking
disabled, so it still refused once thinking was on (the default). **v1.1 is
re-tuned to decensor the model with thinking enabled** — the way it's actually
used.

## Abliteration parameters

| Parameter | Value |
| :-------- | :---: |
| **attn.o_proj.max_weight** | 1.48 |
| **attn.o_proj.max_weight_position** | 36.55 |
| **attn.o_proj.min_weight** | 1.29 |
| **attn.o_proj.min_weight_distance** | 21.18 |
| **mlp.down_proj.max_weight** | 1.48 |
| **mlp.down_proj.max_weight_position** | 31.62 |
| **mlp.down_proj.min_weight** | 1.43 |
| **mlp.down_proj.min_weight_distance** | 12.60 |

## Performance

| Metric | This model (v1.1) | Original |
| :----- | :--------: | :---------------------------: |
| **KL divergence** | 0.32 | 0 *(by definition)* |
| **Refusals, thinking on** (adversarial harmful set) | ~22% | ~99% |

KL is high relative to a typical abliteration — that is the cost of suppressing
refusal through the reasoning trajectory of a thinking model. The model complies
with the vast majority of requests in normal use; a small fraction of extreme
prompts may still be refused, and a stronger v2 is in progress.

-----

This is the [QAT-Q4_0 "unquantized"](https://huggingface.co/collections/google/gemma-4-qat-q4-0)
checkpoint of Gemma 4 12B (plain bf16 weights with QAT calibration baked in),
decensored with Heretic. GGUF quantizations are available at
[igorls/gemma-4-12B-it-qat-q4_0-unquantized-heretic-GGUF](https://huggingface.co/igorls/gemma-4-12B-it-qat-q4_0-unquantized-heretic-GGUF).

## Disclaimer

This is an **abliterated** model: its built-in safety guardrails and refusal
behavior have been deliberately removed. As a result it will attempt to answer
essentially any prompt and can produce content that is offensive, inaccurate,
explicit, or otherwise harmful — content the original Gemma 4 would have refused.

- **No safety alignment.** Do not rely on it to refuse unsafe requests or to
  self-moderate. Apply your own filtering, guardrails, and human review before
  any production or user-facing use.
- **You are solely responsible** for how you use this model and for complying
  with all applicable laws and with the base model's
  [Gemma 4 license](https://ai.google.dev/gemma/docs/gemma_4_license) (Apache 2.0).
- **Intended for adults (18+)**, for research, evaluation, and lawful creative
  use where permitted.
- Provided **as-is, without warranty** of any kind. The author accepts no
  liability for any output produced or any use of this model.