File size: 4,470 Bytes
8ad234a 15daec0 e0f7b51 b165453 8ad234a ce10e19 1f67ba6 8ad234a e5ed00d 8ad234a 1e30620 03f3c3c 1e30620 8ad234a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 | ---
base_model:
- coder3101/gemma-4-26B-A4B-it-heretic
- Gryphe/Gemma-4-26B-A4B-StyleTune-V2
- Gryphe/Pantheon-Reasoning-26B-A4B-1.1-V2
license: gemma
language:
- en
tags:
- roleplay
- merge
- gemma4
- moe
- heretic
- uncensored
- sillytavern
- thinking
- reasoning
---
# Boulesis-v2-26B-A4B
[I made v2.1! The best Boulesis model for now](https://huggingface.co/SubMaroon/Boulesis-v2.1-26B-A4B)
-------------------
Composite Gemma 4 RP model (QK task arithmetic + fused LoRA). Second iteration.
The idea was to retain the model's core intelligence and knowledge, while diversifying its prose and making it more decisive. I also wanted to sharpen its attention to context so it could dig deeper into the character card, organically pulling lore and facts into the roleplay rather than just mirroring the user.
> [!Tip]
> # Differences between Boulesis versions
>
> **v1**: Delivers a **more dynamic plot** and drives the characters to take more action. Suitable for action-oriented scenarios.
>
> **v2**: Writes **very concisely** while maintaining logic; it may even slightly deepen the understanding of the character.
>
> **v2.1**: Comparable in length to v1 and slightly more measured in tone, but it has the **best grasp of the characters and an excellent memory for context**. Suitable for complex RP sessions involving multiple characters.
-----------------
--------------------
## What changed from v1
| | v1 | v2 |
|---|---|---|
| QK donor | Pantheon-Reasoning-1.1 | Pantheon-Reasoning-1.1-**V2** |
| QK alpha | 0.6 sliding q/k, 0.6 global q, **0** global k | **0.85** sliding q/k, **0.65** global q/k |
| LoRA layers | all 30 | **10–28** |
| LoRA targets | 55 | **35** |
| Bake scale | 0.26 | **0.70** |
| Training data | mixed EN/RU | **English only** |
MoE experts, the router, embeddings, MLP and the vision tower are
identical to the abliterated body, verified by tensor comparison after every
step.
<details><summary>How big the QK edit actually is</summary>
I measured the task vector before merging instead of picking alpha by feel.
Relative Frobenius norm against the base weights:
| Group | mean | max |
|---|---|---|
| sliding_q | 0.00278 | 0.00518 |
| sliding_k | 0.00263 | 0.00474 |
| global_q | 0.00356 | 0.00436 |
| global_k | 0.00286 | 0.00395 |
Per-row rotation at the release alphas, in degrees:
| Group | alpha | mean | max |
|---|---|---|---|
| sliding_q | 0.85 | 0.12 | 3.08 |
| sliding_k | 0.85 | 0.12 | 5.87 |
| global_q | 0.65 | 0.12 | 1.72 |
| global_k | 0.65 | 0.09 | 9.53 |
It's not much, but it's honest work.
</details>
## Using it
## <span style="color: #22c55e;">YOU WILL GET THE BEST RESULTS WITH THINKING ON!</span>
> [!Note]
> Recommended settings:
>
>| Parameter | Value |
>|---|---|
>| **Temperature** | `1.0` |
>| **Top-K** | `64` |
>| **Repetition Penalty** | `1.05-1.1` |
>| **Top-P** | `0.95` |
>Thanks to [DifficultyThin8462](https://www.reddit.com/r/SillyTavernAI/comments/1w9abpf/comment/p8b064y/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button)
<details>
<summary><b>If the reasoning doesn't work when connecting GGUF ver. in KoboldCPP and SillyTavern</b></summary>
You need to force this in KoboldCPP.
Go to the Content tab and enable these options.
For SillyTavern, it is recommended to set the template as shown:
</details>
## Feedback
This is an experimental merge, and I mostly test it on my own cards, so my coverage is narrow. If you run v2, I would really like to know:
- Whether you ran it with thinking enabled or disabled.
- How it holds up in long sessions — scene logic, character positions, who is
addressing whom. This was the main complaint about v1 and the reason v2 exists.
- Your sampler settings, if you got clearly better or worse results than with
the defaults.
Open a thread in the Community tab, I read all of them. If anyone wants to be involved in v3, I am open to that as well!
## Credits
Thanks to `coder3101` and `Gryphe` for the fine-tunes, and the entire
`26B-Suite` team for their intellectual support.
Speсial thanks for [Naphula](https://huggingface.co/Naphula),
[redaihf](https://huggingface.co/redaihf) and
[Vortex5](https://huggingface.co/Vortex5). You guys are awesome! |