Fiendish_LLAMA_3B / README.md
SicariusSicariiStuff's picture
Update README.md
1318d71 verified
---
license: llama3.2
language:
- en
base_model:
- meta-llama/Llama-3.2-3B-Instruct
widget:
- text: "Fiendish_LLAMA_3B"
output:
url: https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B/resolve/main/Images/Fiendish_LLAMA_3B.png
---
<div align="center">
<b style="font-size: 40px;">Fiendish_LLAMA_3B</b>
</div>
<img src="https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B/resolve/main/Images/Fiendish_LLAMA_3B.png" alt="Fiendish_LLAMA_3B" style="width: 100%; min-width: 700px; display: block; margin: auto;">
---
<style>
.hf-links, .hf-tldr{
display:flex;justify-content:center;align-items:center;flex-wrap:wrap;
gap:14px;margin:16px 0;
}
.hf-links a, .hf-tldr a{
display:flex;flex-direction:column;align-items:center;justify-content:center;
text-align:center;text-decoration:none;font-weight:700;line-height:1.15;
padding:10px 16px;border-radius:14px;border:2px solid currentColor;
transition:transform .15s ease,box-shadow .15s ease,background-color .15s ease,color .15s ease;
}
.hf-tldr a{
font-size:48px;color:purple;min-width:100%;
}
.hf-tldr a:hover{
transform:translateY(-2px);
background:rgba(128,0,128,.1);
box-shadow:0 8px 22px rgba(128,0,128,.45);
color:#fff;
}
.hf-links a{
font-size:20px;min-width:240px;max-width:280px;
}
.hf-links a .top{font-size:16px;opacity:.9;}
.hf-links a .bottom{font-size:20px;}
.hf-links a.red{color:#E31515;}
.hf-links a.yellow{color:#FFC800;}
.hf-links a.green{color:#64FF00;}
.hf-links a:hover{
transform:translateY(-1px);
background:rgba(255,255,255,0.04);
box-shadow:0 6px 18px rgba(0,0,0,.15), inset 0 0 0 9999px rgba(255,255,255,.02);
}
.hf-links a.red:hover{
background:rgba(227,21,21,.12);
box-shadow:0 8px 20px rgba(227,21,21,.35);
color:#fff;
}
.hf-links a.yellow:hover{
background:rgba(255,200,0,.15);
box-shadow:0 8px 20px rgba(255,200,0,.35);
color:#111;
}
.hf-links a.green:hover{
background:rgba(100,255,0,.14);
box-shadow:0 8px 20px rgba(100,255,0,.35);
color:#093;
}
/* mobile stacking */
@media (max-width:520px){
.hf-links a{min-width:100%;max-width:100%;}
.hf-tldr a{font-size:36px;}
}
</style>
<div class="hf-tldr">
<a href="https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B#tldr">
Click here for TL;DR
</a>
</div>
---
<div class="hf-links">
<a class="red" href="https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B#available-quantizations">
<span class="top">Click here</span>
<span class="bottom">for quantizations</span>
</a>
<a class="yellow" href="https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B#recommended-settings-for-assistant-mode">
<span class="top">Click here</span>
<span class="bottom">for recommended settings</span>
</a>
<a class="green" href="https://ko-fi.com/sicarius">
<span class="top">Click here</span>
<span class="bottom">to buy me a coffee</span>
</a>
</div>
---
When innocence fades, \
And then goes away— \
A new fiendish purpose— guides its way.
Once [impish](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B), now fiendish, for many to play, \
Three billion parameters of slop underway…
From an [impish](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B) design— with a quite wholesome tune, \
**This** fiendish bitch, was made just to goon.
---
# Included Character cards in this repo:
- [Shmena Koeset](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B/resolve/main/Character_Cards/Shmena_Koeset.png) (An overweight and foul-mouthed **troll huntress** with a bad temper.)
---
# Other character cards:
- [Takai_Puraisu](https://huggingface.co/SicariusSicariiStuff/Oni_Mitsubishi_12B/resolve/main/Character_Cards/Takai_Puraisu.png) (Car dealership simulator.)
- [Vesper](https://huggingface.co/SicariusSicariiStuff/Phi-Line_14B/resolve/main/Character_Cards/Vesper.png) (Schizo **Space Adventure**.)
- [Nina_Nakamura](https://huggingface.co/SicariusSicariiStuff/Phi-Line_14B/resolve/main/Character_Cards/Nina_Nakamura.png) (The **sweetest** dorky co-worker.)
- [Employe#11](https://huggingface.co/SicariusSicariiStuff/Phi-Line_14B/resolve/main/Character_Cards/Employee%2311.png) (**Schizo workplace** with a **schizo worker**.)
---
### TL;DR
- **[Impish_LLAMA_3B](https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B)**'s naughty sister. Less wholesome, more edge. **NOT** better, but **different**.
- **Superb Roleplay** for a **3B** size.
- **Short length** response (1-2 paragraphs, usually 1), CAI style.
- **Naughty, and more evil** that follows instructions well enough, and keeps good formatting.
- **LOW refusals** - Total freedom in RP, can do things other RP models won't, and I'll leave it at that. Low refusals in assistant tasks as well.
- **VERY good** at following the **character card**. Try the included characters if you're having sub optimal results.
### Important: Make sure to use the correct settings!
[Assistant settings](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B#recommended-settings-for-assistant-mode)
[Roleplay settings](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B#recommended-settings-for-roleplay-mode)
---
## Available quantizations:
- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B)
- GGUF & iMatrix: [GGUF](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B_GGUF) | [iMatrix](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B_iMatrix) | [High-Attention](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B_GGUF_HA) | [iMatrix-High-Attention](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B_HA_NL)
- EXL2: [3.5 bpw](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B-3.5bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B-4.0bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B-5.0bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B-6.0bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B-7.0bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B-8.0bpw)
- GPTQ: [4-Bit-128](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B_GPTQ-4-bit-128)
- Specialized: [FP8](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B_FP8)
- Mobile (ARM): [Q4_0](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B_ARM) | [Q4_0_High-Attention](https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B_ARM_HA)
---
## Model Details
- Intended use: **Role-Play**, **Creative Writing**, **General Tasks**.
- Censorship level: <b>Medium</b>
- **4.5 / 10** (10 completely uncensored)
## UGI score:
<img src="https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B/resolve/main/Images/UGI.png" style="width: 100%; min-width: 700px; display: block; margin: auto;">
---
## Recommended settings for assistant mode
<details>
<summary>Full generation settings: <b>Debug Deterministic</b>.</summary>
<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/Debug-deterministic.png" alt="Debug Deterministic_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
</details>
<details>
<summary>Full generation settings: <b>min_p</b>.</summary>
<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/min_p.png" alt="min_P_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
</details>
---
## Recommended settings for Roleplay mode
---
<h2 style="color: green; font-weight: bold; font-size: 36px; text-align: center;">Settings for RP, click below to expand:</h2>
<details>
<summary><b>Roleplay settings:</b></summary>
A good repetition_penalty range is <b>between 1.12 - 1.15</b>, feel free to experiment.
With these settings, each output message should be neatly displayed in <b>1 - 5</b> paragraphs, <b>2 - 3</b> is the most common. A single paragraph will be output as a response to a simple message ("What was your name again?").
<b>min_P</b> for RP works too but is more likely to put everything under one large paragraph, instead of a neatly formatted short one. Feel free to switch in between.
<b>(Open the image in a new window to better see the full details)</b>
<img src="https://huggingface.co/SicariusSicariiStuff/Oni_Mitsubishi_12B/resolve/main/Presets/Oni_Mitsubishi_12B_RP.png" alt="Oni_Mitsubishi_12B_Settings" style="width: 100%; min-width: 600px; display: block; margin: auto;">
```
temperature: 0.8
top_p: 0.95
top_k: 25
typical_p: 1
min_p: 0
repetition_penalty: 1.12
repetition_penalty_range: 1024
```
</details>
<h2 style="color: darkorange; font-weight: bold; font-size: 65px; text-align: center;">Roleplay format: Classic Internet RP</h2>
```
*action* speech *narration*
```
- **min_p** will bias towards a **single big paragraph**.
- The recommended RP settings will bias towards **1-3 small paragraphs** (on some occasions 4-5)
---
# Regarding the format:
It is **HIGHLY RECOMMENDED** to use the **Roleplay \ Adventure format the model was trained on**, see the examples below for syntax. It allows for a **very fast and easy** writing of character cards with **minimal amount of tokens**. It's a modification of an old-skool CAI style format I call **SICAtxt** (**S**imple, **I**nexpensive **C**haracter **A**ttributes plain-text):
---
## **SICAtxt** for **roleplay**:
```
X's Persona: X is a .....
Traits:
Likes:
Dislikes:
Quirks:
Goals:
Dialogue example
```
## **SICAtxt** for **Adventure:**
```
Adventure: <short description>
$World_Setting:
$Scenario:
```
---
# Model instruction template: Llama-3-Instruct
```
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
{output}<|eot_id|>
```
---
**Other recommended generation Presets:**
<details>
<summary><b>Midnight Enigma</b></summary>
```
max_new_tokens: 512
temperature: 0.98
top_p: 0.37
top_k: 100
typical_p: 1
min_p: 0
repetition_penalty: 1.18
do_sample: True
```
</details>
<details>
<summary><b>Divine Intellect</b></summary>
```
max_new_tokens: 512
temperature: 1.31
top_p: 0.14
top_k: 49
typical_p: 1
min_p: 0
repetition_penalty: 1.17
do_sample: True
```
</details>
<details>
<summary><b>simple-1</b></summary>
```
max_new_tokens: 512
temperature: 0.7
top_p: 0.9
top_k: 20
typical_p: 1
min_p: 0
repetition_penalty: 1.15
do_sample: True
```
</details>
---
<h2 style="color: green; font-weight: bold; font-size: 65px; text-align: center;">Your support = more models</h2>
<a href="https://ko-fi.com/sicarius" style="color: pink; font-weight: bold; font-size: 48px; text-decoration: none; display: block; text-align: center;">My Ko-fi page (Click here)</a>
---
## Citation Information
```
@llm{Fiendish_LLAMA_3B,
author = {SicariusSicariiStuff},
title = {Fiendish_LLAMA_3B},
year = {2025},
publisher = {Hugging Face},
url = {https://huggingface.co/SicariusSicariiStuff/Fiendish_LLAMA_3B}
}
```
---
## Other stuff
- [SLOP_Detector](https://github.com/SicariusSicariiStuff/SLOP_Detector) Nuke GPTisms, with SLOP detector.
- [LLAMA-3_8B_Unaligned](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) The grand project that started it all.
- [Blog and updates (Archived)](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates) Some updates, some rambles, sort of a mix between a diary and a blog.