| --- |
| license: apache-2.0 |
| language: |
| - en |
| base_model: |
| - Gryphe/Gemma-4-31B-StyleTune |
| tags: |
| - gemma4 |
| - styletune |
| - voice |
| - gguf |
| - roleplay |
| - creative-writing |
| - style-transfer |
| library_name: voice |
| pipeline_tag: text-generation |
| --- |
| |
| <p align="center"><strong>The strongest cliché reduction in the family — as a 2.8 GB download.</strong></p> |
|
|
| # Gemma-4-31B-StyleTune-Voice |
|
|
| **60% fewer clichés. 21.7% shared vocabulary. One tensor. ~2.8 GB.** |
|
|
| The 31B is the original StyleTune — the one where Gryphe first proved a single tensor can carry a whole writing style. This repo is that voice, extracted and portable. Pair it with the [Voice tool](https://huggingface.co/Wiself/voice) and any **Gemma 4 31B** GGUF you already have becomes StyleTune-voiced. |
|
|
| --- |
|
|
| ## The numbers that matter |
|
|
| From [Gryphe's card](https://huggingface.co/Gryphe/Gemma-4-31B-StyleTune) — 200 diverse roleplay prompts, greedy 0.0, versus the base instruct: |
|
|
| | Voice | Clichés / 100 words | Reduction | Shared trigram vocab | |
| |---|---|---|---| |
| | **31B (this one)** | 1.23 → **0.52** | **−60%** | 21.7% | |
| | 12B | 1.050 → 0.463 | −56% | 16.8% | |
| | 26B A4B V2 | 1.141 → 0.551 | −52% | 19.9% | |
|
|
| The 31B posts the largest cliché reduction of the family. If you want the strongest de-slop effect and have the VRAM for a 31B, this is the one. |
|
|
| --- |
|
|
| ## Two steps |
|
|
| ```bash |
| # 1. Get the voice tool (one-time): https://huggingface.co/Wiself/voice |
| python3 voice.py path |
| |
| # 2. Cast it onto any Gemma 4 31B GGUF you already have |
| voice cast ./gemma-4-31b-it-Q4_K_M.gguf voice.safetensors --out ./voiced/gemma-4-31b-styletune.gguf |
| ``` |
| Append `--speak` to force the voice through `output.weight` (invented if the target lacks it and geometry survives; GGUF only). |
|
|
| Run it: |
|
|
| ```bash |
| llama serve -m ./voiced/gemma-4-31b-styletune.gguf --jinja |
| ``` |
|
|
| One file out, nothing extra at runtime. |
|
|
| --- |
|
|
| ## The technique, in one paragraph |
|
|
| Gryphe froze all 30 transformer layers — every attention head, every MLP — and trained **only** the `lm_head` output projection: the last stop before text appears on your screen. One overnight run on consumer hardware. All reasoning, world knowledge, and instruction following stay in the untouched tensors; the voice lives entirely in the trained one. That separation is what makes it liftable — we take the trained tensor and nothing else. |
|
|
| --- |
|
|
| ## What's inside |
|
|
| - `voice.safetensors` — the `lm_head.weight` tensor, **BF16**, shape `[262144, 5376]`, ~2.8 GB |
| - `voice.json` — metadata: source, dtype, shape, architecture |
|
|
| Bit-for-bit identical to the tensor in [Gryphe/Gemma-4-31B-StyleTune](https://huggingface.co/Gryphe/Gemma-4-31B-StyleTune). |
|
|
| --- |
|
|
| ## Compatibility |
|
|
| | Target | Works? | |
| |---|---| |
| | Any Gemma 4 **31B** GGUF (any quant) | ✅ | |
| | Abliterated / uncensored 31B GGUFs | ✅ (delta path if it loops — see [12B card](https://huggingface.co/Wiself/gemma-4-12B-Styletune-Voice#loops--abliterated-targets)) | |
| | Gemma 4 other sizes (9B, 12B, 26B) | ❌ shape mismatch — use the matching voice | |
| | Non-Gemma architectures | ❌ | |
|
|
| --- |
|
|
| ## Notes |
|
|
| - **Precision:** stored at original BF16. Casting quantizes only the head to Q8_0 (near-lossless); all other tensors byte-copied. |
| - **Sampler tips from Gryphe:** temp 1.0, MinP 0.10, DRY sampler on. Gemma 4's native chat template applies automatically. |
| - Verify: `voice info voice.safetensors` → `lm_head.weight · [262144, 5376] · BF16`. |
|
|
| --- |
|
|
| ## Family |
|
|
| All StyleTune voices, same tool, same two-step flow: |
|
|
| - [12B voice](https://huggingface.co/Wiself/gemma-4-12B-Styletune-Voice) · [26B A4B V2 voice](https://huggingface.co/Wiself/gemma-4-26B-A4B-Styletune-V2-Voice) · [26B A4B QAT voice](https://huggingface.co/Wiself/gemma-4-26B-A4B-QAT-Styletune-V2-Voice) · **31B voice (this repo)** |
|
|
| Source models: [Gryphe/Gemma-4-12B-StyleTune](https://huggingface.co/Gryphe/Gemma-4-12B-StyleTune) · [Gryphe/Gemma-4-26B-A4B-StyleTune-V2](https://huggingface.co/Gryphe/Gemma-4-26B-A4B-StyleTune-V2) · [Gryphe/Gemma-4-31B-StyleTune](https://huggingface.co/Gryphe/Gemma-4-31B-StyleTune) |
|
|
| --- |
|
|
| ## Credits |
|
|
| [Gryphe](https://huggingface.co/Gryphe) — the StyleTune technique, the MythoMax lineage discovery that `lm_head` carries style, and all benchmarks cited above. [Anthracite](https://huggingface.co/anthracite-org), [Latitude](https://huggingface.co/LatitudeGames). Tool: [Voice](https://huggingface.co/Wiself/voice). Gemma 4 is Google's model under Gemma terms — check the [source card](https://huggingface.co/Gryphe/Gemma-4-31B-StyleTune) before sharing voiced models. |
|
|
