---
license: gemma
language:
  - en
  - ru
base_model: Naphula/Goetia-26B-A4B-v1.3-Absolute-Heretic-ARA
tags:
  - lora
  - roleplay
  - sillytavern
  - english
  - russian
  - gemma4
  - moe
pipeline_tag: text-generation
library_name: peft
---

Atmospheric genre LoRA adapter primarily for English-language roleplay (also works in Russian). Adds a darker, more literary tone to the narrative. Designed exclusively to adjust style and response structure in "Dark Fantasy" RP. The adapter does not contain any plots or characters from the training data.


# Recommended Scale Settings
| Scale | Effect (Test setup: SillyTavern + [Preset](https://github.com/SpicyMarinara/SillyTavern-Settings/blob/main/Marinara%27s%20Essentials/Preset/Marinara%27s%20Spaghetti%20Recipe.json) + 2000+ token character card) |
|---|---|
| 0.1–0.3 | Effect barely noticeable |
| 0.2–0.3 | Minimal / partial influence |
| 0.3–0.55 | Recommended (stable, controlled style) |
| 0.55+ | Very strong influence (can start overpowering the base model) |

**Note**: Performs reliably in all RP scenarios at scales above 0.5. The darker literary tone becomes most pronounced in Dark Fantasy settings. Best used in full roleplay sessions (SillyTavern with character card + system prompt). Isolated short prompts may show a weaker effect.

## Training

- **Base:** Naphula/Goetia-26B-A4B-v1.3-Absolute-Heretic-ARA (Gemma 4 MoE, abliterated)
- **Method:** QLoRA, attention-only (`q/k/v/o_proj`, 30 layers of the text tower), r=16, alpha=32, 2 epochs, completion-only loss
- **Data:** Novel broken down into scenes → scenes rewritten by a neural network into a synthetic RP dataset (actions and internal thoughts preserved, original author’s prose style removed). Dataset contains both English and Russian samples, with primary focus on English.

## Limitations

- **18+.** Base model is abliterated, training data includes adult and dark content.
- Primarily optimized for English. Works in Russian as well, but the effect is generally weaker.
- Inherits Gemma license terms.