Text Generation
Transformers
Safetensors
llama
Merge
mergekit
Sakana-ai
Research-Made-Model
lazymergekit
finetuned
further-trained
roleplay
creative-writing
storytelling
character-ai
Guilherme34/Firefly
SicariusSicariiStuff/Impish_LLAMA_3B
conversational
text-generation-inference
Instructions to use Guilherme34/Firefly-V3.2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Guilherme34/Firefly-V3.2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Guilherme34/Firefly-V3.2") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Guilherme34/Firefly-V3.2") model = AutoModelForCausalLM.from_pretrained("Guilherme34/Firefly-V3.2", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Guilherme34/Firefly-V3.2 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Guilherme34/Firefly-V3.2" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Guilherme34/Firefly-V3.2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Guilherme34/Firefly-V3.2
- SGLang
How to use Guilherme34/Firefly-V3.2 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Guilherme34/Firefly-V3.2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Guilherme34/Firefly-V3.2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Guilherme34/Firefly-V3.2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Guilherme34/Firefly-V3.2", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Guilherme34/Firefly-V3.2 with Docker Model Runner:
docker model run hf.co/Guilherme34/Firefly-V3.2
Rewrite model card for clarity and readability
Browse files
README.md
CHANGED
|
@@ -18,463 +18,131 @@ tags:
|
|
| 18 |
library_name: transformers
|
| 19 |
---
|
| 20 |
|
| 21 |
-
<div align="center">
|
| 22 |
-
|
| 23 |
-
<
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
|
| 27 |
-
<
|
| 28 |
-
|
| 29 |
-
<
|
| 30 |
-
<
|
| 31 |
-
<
|
| 32 |
-
<
|
| 33 |
-
</linearGradient>
|
| 34 |
-
<radialGradient id="firefly_v3_core" cx="0" cy="0" r="1" gradientUnits="userSpaceOnUse" gradientTransform="translate(52 52) rotate(90) scale(40)">
|
| 35 |
-
<stop stop-color="#F5D0FE"/>
|
| 36 |
-
<stop offset=".55" stop-color="#60A5FA"/>
|
| 37 |
-
<stop offset="1" stop-color="#172033" stop-opacity="0"/>
|
| 38 |
-
</radialGradient>
|
| 39 |
-
</defs>
|
| 40 |
-
|
| 41 |
-
<circle cx="52" cy="52" r="42" fill="url(#firefly_v3_core)" opacity=".36">
|
| 42 |
-
<animate attributeName="opacity" values=".22;.50;.22" dur="3.8s" repeatCount="indefinite"/>
|
| 43 |
-
</circle>
|
| 44 |
-
|
| 45 |
-
<circle cx="52" cy="52" r="36" stroke="url(#firefly_v3_gradient)" stroke-width="2" opacity=".48">
|
| 46 |
-
<animate attributeName="r" values="32;39;32" dur="4.5s" repeatCount="indefinite"/>
|
| 47 |
-
<animate attributeName="opacity" values=".26;.62;.26" dur="4.5s" repeatCount="indefinite"/>
|
| 48 |
-
</circle>
|
| 49 |
-
|
| 50 |
-
<path d="M52 17L61.8 39.6L86 43L68.2 59.6L72.6 84L52 71.6L31.4 84L35.8 59.6L18 43L42.2 39.6L52 17Z" stroke="url(#firefly_v3_gradient)" stroke-width="3" stroke-linejoin="round">
|
| 51 |
-
<animate attributeName="opacity" values=".72;1;.72" dur="2.6s" repeatCount="indefinite"/>
|
| 52 |
-
</path>
|
| 53 |
-
</path>
|
| 54 |
-
</svg>
|
| 55 |
-
|
| 56 |
-
<h1 style="margin:0;color:#ffffff;font-size:62px;line-height:1;font-weight:950;letter-spacing:-2px;">
|
| 57 |
-
Firefly-V3.2
|
| 58 |
-
</h1>
|
| 59 |
-
|
| 60 |
-
<p style="margin:20px auto 0;max-width:820px;color:#d8d3e7;font-size:19px;line-height:1.8;">
|
| 61 |
-
A heavily refined <strong>roleplay-first language model</strong>, built from a novel method(Sakana AI Text to Lora paper)
|
| 62 |
-
<strong>additional training</strong>, <strong>EVERYTHING</strong> FROM <strong>Firefly-V3 but Better</strong>.
|
| 63 |
-
<a href="https://huggingface.co/mradermacher/Firefly-V3.2-GGUF">(btw if you need the GGUF: https://huggingface.co/mradermacher/Firefly-V3.2-GGUF)</a>
|
| 64 |
-
</p>
|
| 65 |
-
|
| 66 |
-
<p style="margin:14px auto 0;max-width:780px;color:#f0abfc;font-size:16px;line-height:1.7;font-weight:800;">
|
| 67 |
-
My personal strongest roleplay model to date now with improvements on roleplay, coherency and math, a literal BRAIN UPGRADE.
|
| 68 |
-
</p>
|
| 69 |
-
|
| 70 |
-
<div style="margin:32px auto 0;display:flex;flex-wrap:wrap;justify-content:center;align-items:center;gap:10px;max-width:940px;">
|
| 71 |
-
|
| 72 |
-
<span style="display:inline-flex;align-items:center;gap:8px;background:linear-gradient(180deg,#24162e,#111827);border:1px solid #613574;color:#f0abfc;padding:10px 17px;border-radius:999px;font-weight:800;box-shadow:inset 0 1px 0 rgba(255,255,255,.05);">
|
| 73 |
-
<svg width="17" height="17" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 74 |
-
<path d="M21 15a2 2 0 01-2 2H7l-4 4V5a2 2 0 012-2h14a2 2 0 012 2z"/>
|
| 75 |
-
<animate attributeName="opacity" values=".65;1;.65" dur="2.6s" repeatCount="indefinite"/>
|
| 76 |
-
</svg>
|
| 77 |
-
Roleplay
|
| 78 |
-
</span>
|
| 79 |
-
|
| 80 |
-
<span style="display:inline-flex;align-items:center;gap:8px;background:linear-gradient(180deg,#1f1b32,#111827);border:1px solid #4f46e5;color:#a5b4fc;padding:10px 17px;border-radius:999px;font-weight:800;box-shadow:inset 0 1px 0 rgba(255,255,255,.05);">
|
| 81 |
-
<svg width="17" height="17" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 82 |
-
<path d="M4 19.5A2.5 2.5 0 016.5 17H20"/>
|
| 83 |
-
<path d="M4 4.5A2.5 2.5 0 016.5 2H20v20H6.5A2.5 2.5 0 014 19.5z"/>
|
| 84 |
-
<animate attributeName="opacity" values=".6;1;.6" dur="3s" repeatCount="indefinite"/>
|
| 85 |
-
</svg>
|
| 86 |
-
Storytelling
|
| 87 |
-
</span>
|
| 88 |
-
|
| 89 |
-
<span style="display:inline-flex;align-items:center;gap:8px;background:linear-gradient(180deg,#182335,#111827);border:1px solid #315d7a;color:#7dd3fc;padding:10px 17px;border-radius:999px;font-weight:800;box-shadow:inset 0 1px 0 rgba(255,255,255,.05);">
|
| 90 |
-
<svg width="17" height="17" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 91 |
-
<path d="M8 21h8"/>
|
| 92 |
-
<path d="M12 17v4"/>
|
| 93 |
-
<path d="M7 4h10"/>
|
| 94 |
-
<path d="M17 4v5a5 5 0 01-10 0V4"/>
|
| 95 |
-
<animateTransform attributeName="transform" type="translate" values="0 0;0 -1;0 0" dur="2s" repeatCount="indefinite"/>
|
| 96 |
-
</svg>
|
| 97 |
-
Character Acting
|
| 98 |
-
</span>
|
| 99 |
-
|
| 100 |
-
<span style="display:inline-flex;align-items:center;gap:8px;background:linear-gradient(180deg,#1c2518,#111827);border:1px solid #315f42;color:#86efac;padding:10px 17px;border-radius:999px;font-weight:800;box-shadow:inset 0 1px 0 rgba(255,255,255,.05);">
|
| 101 |
-
<svg width="17" height="17" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 102 |
-
<path d="M3 12h18"/>
|
| 103 |
-
<path d="M3 6h18"/>
|
| 104 |
-
<path d="M3 18h18"/>
|
| 105 |
-
<animate attributeName="opacity" values=".55;1;.55" dur="2.2s" repeatCount="indefinite"/>
|
| 106 |
-
</svg>
|
| 107 |
-
Long Chats
|
| 108 |
-
</span>
|
| 109 |
-
|
| 110 |
-
<span style="display:inline-flex;align-items:center;gap:8px;background:linear-gradient(180deg,#332117,#111827);border:1px solid #7c4a22;color:#fdba74;padding:10px 17px;border-radius:999px;font-weight:800;box-shadow:inset 0 1px 0 rgba(255,255,255,.05);">
|
| 111 |
-
<svg width="17" height="17" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 112 |
-
<path d="M12 20h9"/>
|
| 113 |
-
<path d="M16.5 3.5a2.1 2.1 0 013 3L7 19l-4 1 1-4 12.5-12.5z"/>
|
| 114 |
-
<animateTransform attributeName="transform" type="rotate" values="0 12 12;4 12 12;0 12 12;-4 12 12;0 12 12" dur="3s" repeatCount="indefinite"/>
|
| 115 |
-
</svg>
|
| 116 |
-
Creative Writing
|
| 117 |
-
</span>
|
| 118 |
-
|
| 119 |
-
<span style="display:inline-flex;align-items:center;gap:8px;background:linear-gradient(180deg,#171a35,#111827);border:1px solid #3f4a8a;color:#a5b4fc;padding:10px 17px;border-radius:999px;font-weight:800;box-shadow:inset 0 1px 0 rgba(255,255,255,.05);">
|
| 120 |
-
<svg width="17" height="17" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 121 |
-
<path d="M12 2v20"/>
|
| 122 |
-
<path d="M5 8h14"/>
|
| 123 |
-
<path d="M7 16h10"/>
|
| 124 |
-
<animate attributeName="opacity" values=".58;1;.58" dur="2s" repeatCount="indefinite"/>
|
| 125 |
-
</svg>
|
| 126 |
-
Fine-Tuned + Brain Changing
|
| 127 |
-
</span>
|
| 128 |
-
|
| 129 |
-
<span style="display:inline-flex;align-items:center;gap:8px;background:linear-gradient(180deg,#181c28,#111827);border:1px solid #475569;color:#cbd5e1;padding:10px 17px;border-radius:999px;font-weight:800;box-shadow:inset 0 1px 0 rgba(255,255,255,.05);">
|
| 130 |
-
<svg width="17" height="17" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 131 |
-
<path d="M8 3H5a2 2 0 00-2 2v3"/>
|
| 132 |
-
<path d="M16 3h3a2 2 0 012 2v3"/>
|
| 133 |
-
<path d="M8 21H5a2 2 0 01-2-2v-3"/>
|
| 134 |
-
<path d="M16 21h3a2 2 0 002-2v-3"/>
|
| 135 |
-
<path d="M9 9h6v6H9z"/>
|
| 136 |
-
<animateTransform attributeName="transform" type="scale" values="1;1.08;1" dur="2.8s" repeatCount="indefinite"/>
|
| 137 |
-
</svg>
|
| 138 |
-
Merge Foundation
|
| 139 |
-
</span>
|
| 140 |
-
|
| 141 |
</div>
|
| 142 |
|
|
|
|
|
|
|
|
|
|
| 143 |
</div>
|
| 144 |
|
|
|
|
|
|
|
|
|
|
| 145 |
</div>
|
| 146 |
|
| 147 |
-
<
|
| 148 |
-
|
| 149 |
-
---
|
| 150 |
-
|
| 151 |
-
<div align="center">
|
| 152 |
-
|
| 153 |
-
<img src="https://cdn-uploads.huggingface.co/production/uploads/638fd4be2ddd69e70b8cd31c/kYgwK1ZAcFUo1R0djk9EQ.png" alt="Firefly-V3 preview" style="max-width:1040px;width:100%;border-radius:26px;border:1px solid #334155;box-shadow:0 18px 70px rgba(2,6,23,.45);">
|
| 154 |
-
|
| 155 |
-
|
| 156 |
-
</div>
|
| 157 |
-
|
| 158 |
-
|
| 159 |
-
<div align="center">
|
| 160 |
-
|
| 161 |
-
|
| 162 |
|
| 163 |
-
|
| 164 |
-
</video>
|
| 165 |
|
| 166 |
-
---
|
| 167 |
-
|
| 168 |
-
<div style="max-width:1040px;margin:0 auto;font-family:Inter,ui-sans-serif,system-ui,-apple-system,BlinkMacSystemFont,'Segoe UI',sans-serif;">
|
| 169 |
-
|
| 170 |
-
<div style="background:radial-gradient(circle at top,rgba(96,165,250,.18),transparent 38%),linear-gradient(180deg,#0f172a,#070a12);border:1px solid #334155;border-radius:26px;padding:32px;margin:26px auto;box-shadow:0 16px 60px rgba(2,6,23,.42);">
|
| 171 |
|
| 172 |
-
|
| 173 |
-
<svg width="25" height="25" viewBox="0 0 24 24" fill="none" stroke="#7dd3fc" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 174 |
-
<circle cx="11" cy="11" r="8"/>
|
| 175 |
-
<path d="M21 21l-4.35-4.35"/>
|
| 176 |
-
<path d="M8 11h6"/>
|
| 177 |
-
<path d="M11 8v6"/>
|
| 178 |
-
<animate attributeName="opacity" values=".55;1;.55" dur="2.6s" repeatCount="indefinite"/>
|
| 179 |
-
</svg>
|
| 180 |
-
J-Lens Observations
|
| 181 |
-
</h2>
|
| 182 |
|
| 183 |
-
<
|
| 184 |
-
|
| 185 |
-
</p>
|
| 186 |
-
|
| 187 |
-
<div style="display:grid;grid-template-columns:repeat(auto-fit,minmax(280px,1fr));gap:18px;">
|
| 188 |
-
|
| 189 |
-
<div style="background:linear-gradient(180deg,#111827,#0b101b);border:1px solid rgba(125,211,252,.28);border-radius:22px;overflow:hidden;box-shadow:0 12px 42px rgba(2,6,23,.34);">
|
| 190 |
-
<img src="https://cdn-uploads.huggingface.co/production/uploads/638fd4be2ddd69e70b8cd31c/PrkkQ9dm0Or4diepaDGsG.png" alt="J-Lens observation image 1" style="width:100%;height:auto;display:block;object-fit:contain;background:#020617;">
|
| 191 |
-
<div style="padding:20px;">
|
| 192 |
-
<h3 style="margin:0 0 10px;color:#7dd3fc;font-size:18px;">Observation 01 — Getting the Right Thing</h3>
|
| 193 |
-
<p style="margin:0;color:#cbd5e1;line-height:1.75;font-size:15px;">
|
| 194 |
-
The model can think about the entire response while generating the start of it.
|
| 195 |
-
</p>
|
| 196 |
-
</div>
|
| 197 |
</div>
|
| 198 |
|
| 199 |
-
|
| 200 |
-
<img src="https://cdn-uploads.huggingface.co/production/uploads/638fd4be2ddd69e70b8cd31c/FvVOQvv5SS5Tgp0m0Wx5-.png" alt="J-Lens observation image 2" style="width:100%;height:auto;display:block;object-fit:contain;background:#020617;">
|
| 201 |
-
<div style="padding:20px;">
|
| 202 |
-
<h3 style="margin:0 0 10px;color:#c084fc;font-size:18px;">Observation 02 — Thinking Silently</h3>
|
| 203 |
-
<p style="margin:0;color:#cbd5e1;line-height:1.75;font-size:15px;">
|
| 204 |
-
The model can focus on things without saying it, for example i asked what is his greatest fear without saying it, and he did.
|
| 205 |
-
</p>
|
| 206 |
-
</div>
|
| 207 |
-
</div>
|
| 208 |
|
| 209 |
-
|
| 210 |
-
<img src="https://cdn-uploads.huggingface.co/production/uploads/638fd4be2ddd69e70b8cd31c/RboXjNszcvP9s7IbKBcl2.png" alt="J-Lens observation image 3" style="width:100%;height:auto;display:block;object-fit:contain;background:#020617;">
|
| 211 |
-
<div style="padding:20px;">
|
| 212 |
-
<h3 style="margin:0 0 10px;color:#f472b6;font-size:18px;">Observation 03 — Internal Laugh and Joke</h3>
|
| 213 |
-
<p style="margin:0;color:#cbd5e1;line-height:1.75;font-size:15px;">
|
| 214 |
-
The model made a joke to itself and laughed internally.
|
| 215 |
-
</p>
|
| 216 |
-
</div>
|
| 217 |
-
</div>
|
| 218 |
|
| 219 |
-
|
|
|
|
|
|
|
|
|
|
| 220 |
|
| 221 |
-
|
| 222 |
|
| 223 |
-
|
| 224 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 225 |
</div>
|
| 226 |
|
| 227 |
-
|
| 228 |
-
|
| 229 |
-
<div style="max-width:1040px;margin:0 auto;font-family:Inter,ui-sans-serif,system-ui,-apple-system,BlinkMacSystemFont,'Segoe UI',sans-serif;">
|
| 230 |
-
|
| 231 |
-
<div style="background:linear-gradient(180deg,#101827,#0b101b);border:1px solid #334155;border-radius:24px;padding:30px;margin:26px auto;box-shadow:0 12px 48px rgba(2,6,23,.35);">
|
| 232 |
-
|
| 233 |
-
<h2 style="margin:0 0 16px;color:#ffffff;display:flex;align-items:center;gap:12px;">
|
| 234 |
-
<svg width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="#c084fc" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 235 |
-
<path d="M4 19.5A2.5 2.5 0 016.5 17H20"/>
|
| 236 |
-
<path d="M4 4.5A2.5 2.5 0 016.5 2H20v20H6.5A2.5 2.5 0 014 19.5z"/>
|
| 237 |
-
<animate attributeName="opacity" values=".65;1;.65" dur="3s" repeatCount="indefinite"/>
|
| 238 |
-
</svg>
|
| 239 |
-
About Firefly-V3
|
| 240 |
-
</h2>
|
| 241 |
-
|
| 242 |
-
<p style="color:#cbd5e1;line-height:1.8;font-size:16px;">
|
| 243 |
-
<strong>Firefly-V3</strong> is a heavily refined roleplay model created from a merge foundation and then improved through
|
| 244 |
-
additional training, fine-tuning, and roleplay-focused behavioral shaping.
|
| 245 |
-
</p>
|
| 246 |
|
| 247 |
-
|
| 248 |
-
The model was built to deliver stronger character presence, more natural dialogue, better scene flow, and more enjoyable
|
| 249 |
-
long-form roleplay conversations. The merge is only part of its origin. Firefly-V3's final behavior comes from the extra
|
| 250 |
-
training and refinement applied after that foundation.
|
| 251 |
-
</p>
|
| 252 |
|
| 253 |
-
|
| 254 |
-
I personally consider Firefly-V3 the best roleplay model I have made so far.
|
| 255 |
-
</p>
|
| 256 |
|
| 257 |
-
|
| 258 |
-
<strong>About Firefly-V3.2</strong>
|
| 259 |
-
</h2>
|
| 260 |
|
| 261 |
-
|
| 262 |
-
<strong>Firefly-V3.2</strong> is a model that breaks alot of the concept of making an LLM, its more like finding harmony in Chaos of words.
|
| 263 |
-
</p>
|
| 264 |
|
| 265 |
-
|
| 266 |
-
The model was built to do everything V3 could but better!
|
| 267 |
-
</p>
|
| 268 |
|
| 269 |
-
<
|
| 270 |
-
|
| 271 |
-
<
|
| 272 |
-
|
| 273 |
-
|
| 274 |
-
</div>
|
| 275 |
-
|
| 276 |
-
---
|
| 277 |
-
|
| 278 |
-
<div style="display:grid;grid-template-columns:repeat(auto-fit,minmax(235px,1fr));gap:16px;margin:26px auto;">
|
| 279 |
-
|
| 280 |
-
<div style="background:linear-gradient(180deg,#24162e,#0b101b);border:1px solid #613574;border-radius:22px;padding:24px;box-shadow:0 10px 32px rgba(2,6,23,.25);">
|
| 281 |
-
<h3 style="margin:0 0 12px;color:#f0abfc;display:flex;align-items:center;gap:10px;">
|
| 282 |
-
<svg width="22" height="22" viewBox="0 0 24 24" fill="none" stroke="#f0abfc" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 283 |
-
<path d="M21 15a2 2 0 01-2 2H7l-4 4V5a2 2 0 012-2h14a2 2 0 012 2z"/>
|
| 284 |
-
<animate attributeName="opacity" values=".65;1;.65" dur="2.6s" repeatCount="indefinite"/>
|
| 285 |
-
</svg>
|
| 286 |
-
Roleplay First
|
| 287 |
-
</h3>
|
| 288 |
-
<p style="margin:0;color:#cbd5e1;line-height:1.75;">
|
| 289 |
-
Designed around immersive character interaction, emotional pacing, scene continuity, and expressive dialogue. - AWARENESS
|
| 290 |
-
</p>
|
| 291 |
-
</div>
|
| 292 |
-
|
| 293 |
-
<div style="background:linear-gradient(180deg,#1f1b32,#0b101b);border:1px solid #4f46e5;border-radius:22px;padding:24px;box-shadow:0 10px 32px rgba(2,6,23,.25);">
|
| 294 |
-
<h3 style="margin:0 0 12px;color:#a5b4fc;display:flex;align-items:center;gap:10px;">
|
| 295 |
-
<svg width="22" height="22" viewBox="0 0 24 24" fill="none" stroke="#a5b4fc" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 296 |
-
<path d="M4 19.5A2.5 2.5 0 016.5 17H20"/>
|
| 297 |
-
<path d="M4 4.5A2.5 2.5 0 016.5 2H20v20H6.5A2.5 2.5 0 014 19.5z"/>
|
| 298 |
-
<animate attributeName="opacity" values=".6;1;.6" dur="3s" repeatCount="indefinite"/>
|
| 299 |
-
</svg>
|
| 300 |
-
Further Trained
|
| 301 |
-
</h3>
|
| 302 |
-
<p style="margin:0;color:#cbd5e1;line-height:1.75;">
|
| 303 |
-
Firefly-V3 was not released as a raw merge. It was further trained and refined to shape its final personality and RP behavior.
|
| 304 |
-
</p>
|
| 305 |
-
</div>
|
| 306 |
-
|
| 307 |
-
<div style="background:linear-gradient(180deg,#182335,#0b101b);border:1px solid #315d7a;border-radius:22px;padding:24px;box-shadow:0 10px 32px rgba(2,6,23,.25);">
|
| 308 |
-
<h3 style="margin:0 0 12px;color:#7dd3fc;display:flex;align-items:center;gap:10px;">
|
| 309 |
-
<svg width="22" height="22" viewBox="0 0 24 24" fill="none" stroke="#7dd3fc" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 310 |
-
<path d="M8 21h8"/>
|
| 311 |
-
<path d="M12 17v4"/>
|
| 312 |
-
<path d="M7 4h10"/>
|
| 313 |
-
<path d="M17 4v5a5 5 0 01-10 0V4"/>
|
| 314 |
-
<animateTransform attributeName="transform" type="translate" values="0 0;0 -1;0 0" dur="2s" repeatCount="indefinite"/>
|
| 315 |
-
</svg>
|
| 316 |
-
Character Presence
|
| 317 |
-
</h3>
|
| 318 |
-
<p style="margin:0;color:#cbd5e1;line-height:1.75;">
|
| 319 |
-
Built to make characters feel more distinct, expressive, and consistent across longer chats.
|
| 320 |
-
</p>
|
| 321 |
-
</div>
|
| 322 |
-
|
| 323 |
-
<div style="background:linear-gradient(180deg,#332117,#0b101b);border:1px solid #7c4a22;border-radius:22px;padding:24px;box-shadow:0 10px 32px rgba(2,6,23,.25);">
|
| 324 |
-
<h3 style="margin:0 0 12px;color:#fdba74;display:flex;align-items:center;gap:10px;">
|
| 325 |
-
<svg width="22" height="22" viewBox="0 0 24 24" fill="none" stroke="#fdba74" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 326 |
-
<path d="M12 20h9"/>
|
| 327 |
-
<path d="M16.5 3.5a2.1 2.1 0 013 3L7 19l-4 1 1-4 12.5-12.5z"/>
|
| 328 |
-
<animateTransform attributeName="transform" type="rotate" values="0 12 12;4 12 12;0 12 12;-4 12 12;0 12 12" dur="3s" repeatCount="indefinite"/>
|
| 329 |
-
</svg>
|
| 330 |
-
Creative Writing
|
| 331 |
-
</h3>
|
| 332 |
-
<p style="margin:0;color:#cbd5e1;line-height:1.75;">
|
| 333 |
-
Strong for prose, atmosphere, dialogue, character descriptions, and interactive fiction.
|
| 334 |
-
</p>
|
| 335 |
</div>
|
| 336 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 337 |
</div>
|
| 338 |
|
| 339 |
-
-
|
| 340 |
-
|
| 341 |
-
<div style="
|
| 342 |
-
|
| 343 |
-
<
|
| 344 |
-
<
|
| 345 |
-
<path d="M12 20h9"/>
|
| 346 |
-
<path d="M16.5 3.5a2.1 2.1 0 013 3L7 19l-4 1 1-4 12.5-12.5z"/>
|
| 347 |
-
<animate attributeName="opacity" values=".58;1;.58" dur="2.4s" repeatCount="indefinite"/>
|
| 348 |
-
</svg>
|
| 349 |
-
Best For
|
| 350 |
-
</h2>
|
| 351 |
-
|
| 352 |
-
<div style="display:grid;grid-template-columns:repeat(auto-fit,minmax(220px,1fr));gap:12px;">
|
| 353 |
-
|
| 354 |
-
<div style="background:rgba(15,23,42,.72);border:1px solid rgba(148,163,184,.22);border-radius:18px;padding:16px;">
|
| 355 |
-
<div style="color:#ffffff;font-weight:900;">Roleplay chats</div>
|
| 356 |
-
<div style="color:#94a3b8;line-height:1.6;margin-top:5px;">Character-driven conversations and interactive scenes.</div>
|
| 357 |
</div>
|
| 358 |
|
| 359 |
-
|
| 360 |
-
<div style="color:#ffffff;font-weight:900;">Character cards</div>
|
| 361 |
-
<div style="color:#94a3b8;line-height:1.6;margin-top:5px;">Bots with personality, style, and scene memory.</div>
|
| 362 |
-
</div>
|
| 363 |
|
| 364 |
-
<div style="
|
| 365 |
-
<
|
| 366 |
-
<
|
|
|
|
| 367 |
</div>
|
| 368 |
|
| 369 |
-
|
| 370 |
-
<div style="color:#ffffff;font-weight:900;">Long scenes</div>
|
| 371 |
-
<div style="color:#94a3b8;line-height:1.6;margin-top:5px;">Extended interactions that need pacing and continuity.</div>
|
| 372 |
-
</div>
|
| 373 |
|
| 374 |
-
|
| 375 |
|
|
|
|
|
|
|
| 376 |
</div>
|
| 377 |
|
| 378 |
---
|
| 379 |
|
| 380 |
-
<div style="
|
| 381 |
-
|
| 382 |
-
<
|
| 383 |
-
<svg width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="#c084fc" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 384 |
-
<path d="M8 3H5a2 2 0 00-2 2v3"/>
|
| 385 |
-
<path d="M16 3h3a2 2 0 012 2v3"/>
|
| 386 |
-
<path d="M8 21H5a2 2 0 01-2-2v-3"/>
|
| 387 |
-
<path d="M16 21h3a2 2 0 002-2v-3"/>
|
| 388 |
-
<path d="M9 9h6v6H9z"/>
|
| 389 |
-
<animateTransform attributeName="transform" type="scale" values="1;1.08;1" dur="2.8s" repeatCount="indefinite"/>
|
| 390 |
-
</svg>
|
| 391 |
-
Training and Model Lineage
|
| 392 |
-
</h2>
|
| 393 |
-
|
| 394 |
-
<p style="color:#cbd5e1;line-height:1.8;font-size:16px;">
|
| 395 |
-
Firefly-V3 began from <strong>Guilherme34/Firefly-V2.5</strong> and merge components including
|
| 396 |
-
<strong>SicariusSicariiStuff/Impish_LLAMA_3B</strong>, but it did not stop there.
|
| 397 |
-
</p>
|
| 398 |
-
|
| 399 |
-
<p style="color:#cbd5e1;line-height:1.8;font-size:16px;">
|
| 400 |
-
After the merge foundation, the model went through additional training and fine-tuning to improve roleplay behavior,
|
| 401 |
-
character voice, response style, dialogue quality, and long-form scene handling.
|
| 402 |
-
</p>
|
| 403 |
-
|
| 404 |
-
<p style="color:#cbd5e1;line-height:1.8;font-size:16px;margin-bottom:0;">
|
| 405 |
-
Then a method called Text-to-Lora was used for making it more creative, coherent and <strong>AWARE</strong> making now Firefly-V3.2
|
| 406 |
-
</p>
|
| 407 |
-
|
| 408 |
-
</div>
|
| 409 |
-
|
| 410 |
-
---
|
| 411 |
-
|
| 412 |
-
<div style="background:linear-gradient(180deg,#101827,#0b101b);border:1px solid #334155;border-radius:24px;padding:28px;margin:26px auto;box-shadow:0 12px 48px rgba(2,6,23,.32);">
|
| 413 |
-
|
| 414 |
-
<h2 style="margin:0 0 16px;color:#ffffff;display:flex;align-items:center;gap:12px;">
|
| 415 |
-
<svg width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="#60a5fa" stroke-width="2" stroke-linecap="round" stroke-linejoin="round">
|
| 416 |
-
<circle cx="12" cy="8" r="5"/>
|
| 417 |
-
<path d="M20 21a8 8 0 00-16 0"/>
|
| 418 |
-
<animate attributeName="opacity" values=".62;1;.62" dur="3s" repeatCount="indefinite"/>
|
| 419 |
-
</svg>
|
| 420 |
-
Attribution
|
| 421 |
-
</h2>
|
| 422 |
-
|
| 423 |
-
<p style="color:#cbd5e1;line-height:1.8;font-size:16px;">
|
| 424 |
-
<strong>Model:</strong> Firefly-V3<br>
|
| 425 |
-
<strong>Author:</strong> Guilherme34
|
| 426 |
-
</p>
|
| 427 |
-
|
| 428 |
-
<p style="color:#cbd5e1;line-height:1.8;font-size:16px;">
|
| 429 |
-
<strong>Base:</strong> Guilherme34/Firefly-V2.5<br>
|
| 430 |
-
<strong>Merge Component:</strong> SicariusSicariiStuff/Impish_LLAMA_3B
|
| 431 |
-
</p>
|
| 432 |
-
|
| 433 |
-
<p style="color:#cbd5e1;line-height:1.8;font-size:16px;margin-bottom:0;">
|
| 434 |
-
This model is part of the Firefly family and was further trained and refined for users who want a stronger,
|
| 435 |
-
more immersive roleplay experience.
|
| 436 |
-
</p>
|
| 437 |
-
|
| 438 |
</div>
|
| 439 |
|
| 440 |
-
<div style="background: #111118; border-left: 3px solid #ff4500; border-radius: 0 12px 12px 0; padding: 20px 24px; margin-bottom: 24px;">
|
| 441 |
-
<strong>⚠️ Disclaimer</strong>
|
| 442 |
-
<p style="color: #8888a0; font-size: 14px; margin: 8px 0 0 0;">This model is <strong>uncensored</strong> and will generate content without built-in refusals. It is intended for <strong>creative fiction and roleplay between consenting adults.</strong> The creator is not responsible for how the model is used. Do not use it to produce content that is illegal in your jurisdiction.</p>
|
| 443 |
</div>
|
| 444 |
-
|
| 445 |
-
---
|
| 446 |
-
|
| 447 |
-
<div align="center">
|
| 448 |
-
|
| 449 |
-
<div style="background:radial-gradient(circle at 50% 0%,rgba(192,132,252,.24),transparent 40%),linear-gradient(135deg,#080b12,#111827 62%,#172033);border:1px solid #334155;border-radius:28px;padding:36px 28px;margin:26px auto 0;text-align:center;box-shadow:0 18px 70px rgba(2,6,23,.44);">
|
| 450 |
-
|
| 451 |
-
<svg width="54" height="54" viewBox="0 0 54 54" fill="none" style="margin-bottom:14px;">
|
| 452 |
-
<defs>
|
| 453 |
-
<linearGradient id="firefly_v3_footer" x1="8" y1="6" x2="46" y2="48" gradientUnits="userSpaceOnUse">
|
| 454 |
-
<stop stop-color="#C084FC"/>
|
| 455 |
-
<stop offset=".55" stop-color="#60A5FA"/>
|
| 456 |
-
<stop offset="1" stop-color="#F472B6"/>
|
| 457 |
-
</linearGradient>
|
| 458 |
-
</defs>
|
| 459 |
-
<circle cx="27" cy="27" r="20" stroke="url(#firefly_v3_footer)" stroke-width="2" opacity=".35">
|
| 460 |
-
<animate attributeName="r" values="17;22;17" dur="3s" repeatCount="indefinite"/>
|
| 461 |
-
<animate attributeName="opacity" values=".2;.55;.2" dur="3s" repeatCount="indefinite"/>
|
| 462 |
-
</circle>
|
| 463 |
-
<path d="M27 8L32 20L45 22L35.5 31L38 44L27 37L16 44L18.5 31L9 22L22 20L27 8Z" stroke="url(#firefly_v3_footer)" stroke-width="2.3" stroke-linejoin="round">
|
| 464 |
-
<animate attributeName="opacity" values=".7;1;.7" dur="2.4s" repeatCount="indefinite"/>
|
| 465 |
-
</path>
|
| 466 |
-
</svg>
|
| 467 |
-
|
| 468 |
-
<h3 style="color:#ffffff;margin:0;font-size:24px;">
|
| 469 |
-
Firefly-V3.2
|
| 470 |
-
</h3>
|
| 471 |
-
|
| 472 |
-
<p style="color:#cbd5e1;line-height:1.8;max-width:720px;margin:14px auto 0;font-size:16px;">
|
| 473 |
-
A further-improved Firefly-V3 for people who really enjoyed it!
|
| 474 |
-
</p>
|
| 475 |
-
|
| 476 |
-
</div>
|
| 477 |
-
|
| 478 |
-
</div>
|
| 479 |
-
|
| 480 |
-
</div>
|
|
|
|
| 18 |
library_name: transformers
|
| 19 |
---
|
| 20 |
|
| 21 |
+
<div align="center" style="max-width: 980px; margin: 0 auto 28px; padding: 46px 28px; border: 1px solid #34364a; border-radius: 22px; background: linear-gradient(145deg, #111218 0%, #18172a 58%, #111827 100%);">
|
| 22 |
+
<p style="margin: 0 0 10px; color: #9ca3af; font-size: 13px; font-weight: 700; letter-spacing: 0.14em; text-transform: uppercase;">Guilherme34 · Firefly series</p>
|
| 23 |
+
<h1 style="margin: 0; color: #f8fafc; font-size: 48px; line-height: 1.08; letter-spacing: -0.04em;">Firefly-V3.2</h1>
|
| 24 |
+
<p style="max-width: 720px; margin: 18px auto 0; color: #cbd5e1; font-size: 18px; line-height: 1.7;">
|
| 25 |
+
A 3.2B roleplay and creative-writing model built for character presence, natural dialogue, and scenes that keep moving.
|
| 26 |
+
</p>
|
| 27 |
+
<p style="max-width: 720px; margin: 12px auto 0; color: #a5b4fc; font-size: 15px; line-height: 1.7;">
|
| 28 |
+
This is my follow-up to Firefly-V3: same direction, another round of refinement, and fewer rough edges in my testing.
|
| 29 |
+
</p>
|
| 30 |
+
<p style="margin: 24px 0 0;">
|
| 31 |
+
<a href="https://huggingface.co/mradermacher/Firefly-V3.2-GGUF" style="display: inline-block; padding: 10px 16px; border: 1px solid #6366f1; border-radius: 10px; color: #c7d2fe; text-decoration: none; font-weight: 700;">Get the GGUF quantizations</a>
|
| 32 |
+
</p>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
</div>
|
| 34 |
|
| 35 |
+
<div align="center" style="max-width: 980px; margin: 0 auto 24px;">
|
| 36 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/638fd4be2ddd69e70b8cd31c/kYgwK1ZAcFUo1R0djk9EQ.png" alt="Firefly-V3.2 roleplay preview" style="display: block; width: 100%; height: auto; border: 1px solid #34364a; border-radius: 18px;">
|
| 37 |
+
<p style="margin: 9px 0 0; color: #6b7280; font-size: 13px;">A sample from roleplay testing.</p>
|
| 38 |
</div>
|
| 39 |
|
| 40 |
+
<div align="center" style="max-width: 980px; margin: 0 auto 34px;">
|
| 41 |
+
<video src="https://cdn-uploads.huggingface.co/production/uploads/638fd4be2ddd69e70b8cd31c/DyYIOCFJUqmld1-uw0bts.mp4" controls muted loop style="display: block; width: 100%; border: 1px solid #34364a; border-radius: 18px;"></video>
|
| 42 |
+
<p style="margin: 9px 0 0; color: #6b7280; font-size: 13px;">Video preview from the same round of testing.</p>
|
| 43 |
</div>
|
| 44 |
|
| 45 |
+
<div style="max-width: 900px; margin: 0 auto;">
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
+
## What this model is
|
|
|
|
| 48 |
|
| 49 |
+
Firefly-V3.2 is the current version of my small-model roleplay project. It started from the Firefly line, with Firefly-V2.5 as the base and Impish LLAMA 3B as part of the merge foundation. I then applied more roleplay-focused training and an additional refinement pass inspired by the Text-to-LoRA direction from Sakana AI's research.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
+
The goal is not to turn a 3B model into something it is not. The goal is to make a compact model more enjoyable at the things I actually use it for: characters, dialogue, atmosphere, and long interactive scenes.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
|
| 53 |
+
<div style="margin: 26px 0; padding: 22px 24px; border-left: 4px solid #818cf8; border-radius: 0 14px 14px 0; background: #151721;">
|
| 54 |
+
<p style="margin: 0; color: #d1d5db; line-height: 1.75;"><strong style="color: #e0e7ff;">The short version:</strong> if you liked Firefly-V3, this is the version I would try first. In my own tests it is more coherent, steadier in character, and a little less likely to lose the scene.</p>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
</div>
|
| 56 |
|
| 57 |
+
## What changed in V3.2
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 58 |
|
| 59 |
+
I focused on behavior rather than chasing a benchmark headline:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 60 |
|
| 61 |
+
- **Cleaner roleplay flow.** Replies tend to connect more naturally to what just happened instead of feeling like isolated blocks of prose.
|
| 62 |
+
- **Stronger character presence.** Voices and reactions have been more distinct in my testing, especially when the character card gives the model something useful to work with.
|
| 63 |
+
- **Better scene awareness.** It has been more reliable at tracking the immediate situation and carrying details into the next response.
|
| 64 |
+
- **A modest reasoning pass.** I included material aimed at coherence and basic math. This is still a roleplay model, not a math specialist.
|
| 65 |
|
| 66 |
+
These are observations from my own prompts, not benchmark claims. Different frontends, character cards, samplers, and quantizations can change the result a lot.
|
| 67 |
|
| 68 |
+
## Where it works best
|
| 69 |
|
| 70 |
+
<div style="display: grid; grid-template-columns: repeat(auto-fit, minmax(210px, 1fr)); gap: 12px; margin: 20px 0 28px;">
|
| 71 |
+
<div style="padding: 18px; border: 1px solid #34364a; border-radius: 14px; background: #14151c;">
|
| 72 |
+
<h3 style="margin: 0 0 8px; color: #c4b5fd; font-size: 16px;">Roleplay chats</h3>
|
| 73 |
+
<p style="margin: 0; color: #9ca3af; line-height: 1.65;">Character-led conversations, emotional beats, and interactive scenes.</p>
|
| 74 |
+
</div>
|
| 75 |
+
<div style="padding: 18px; border: 1px solid #34364a; border-radius: 14px; background: #14151c;">
|
| 76 |
+
<h3 style="margin: 0 0 8px; color: #a5b4fc; font-size: 16px;">Creative writing</h3>
|
| 77 |
+
<p style="margin: 0; color: #9ca3af; line-height: 1.65;">Dialogue, prose, atmosphere, and continuing an existing scene.</p>
|
| 78 |
+
</div>
|
| 79 |
+
<div style="padding: 18px; border: 1px solid #34364a; border-radius: 14px; background: #14151c;">
|
| 80 |
+
<h3 style="margin: 0 0 8px; color: #93c5fd; font-size: 16px;">Character cards</h3>
|
| 81 |
+
<p style="margin: 0; color: #9ca3af; line-height: 1.65;">Detailed personas with a clear voice, situation, and relationship to the user.</p>
|
| 82 |
+
</div>
|
| 83 |
+
<div style="padding: 18px; border: 1px solid #34364a; border-radius: 14px; background: #14151c;">
|
| 84 |
+
<h3 style="margin: 0 0 8px; color: #67e8f9; font-size: 16px;">Local use</h3>
|
| 85 |
+
<p style="margin: 0; color: #9ca3af; line-height: 1.65;">A compact model for people who want fast iteration and accessible quantizations.</p>
|
| 86 |
+
</div>
|
| 87 |
</div>
|
| 88 |
|
| 89 |
+
## Limits and expectations
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 90 |
|
| 91 |
+
Firefly-V3.2 is a 3.2B model. It can still contradict earlier details, misread an ambiguous card, repeat a phrase, or confidently invent information. Long scenes are a strength I aimed for, not a guarantee of perfect memory.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 92 |
|
| 93 |
+
It is also not the model I would choose first for factual research, difficult math, production code, or anything where a plausible mistake could cause harm. Use it as a creative model and judge it on your own prompts.
|
|
|
|
|
|
|
| 94 |
|
| 95 |
+
I am not publishing benchmark numbers for V3.2 here because I do not have a result set I am comfortable presenting as meaningful. I would rather be clear about that than dress up a few hand-picked examples as proof.
|
|
|
|
|
|
|
| 96 |
|
| 97 |
+
## J-Lens observations
|
|
|
|
|
|
|
| 98 |
|
| 99 |
+
The images below come from exploratory J-Lens sessions. They are interesting clues about how a response may be represented during generation; they are **not** evidence of consciousness, private thoughts, or a benchmark result.
|
|
|
|
|
|
|
| 100 |
|
| 101 |
+
<div style="margin: 22px 0; overflow: hidden; border: 1px solid #34364a; border-radius: 16px; background: #14151c;">
|
| 102 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/638fd4be2ddd69e70b8cd31c/PrkkQ9dm0Or4diepaDGsG.png" alt="J-Lens observation showing information related to the later response" style="display: block; width: 100%; height: auto;">
|
| 103 |
+
<div style="padding: 17px 20px;">
|
| 104 |
+
<h3 style="margin: 0 0 6px; color: #a5b4fc; font-size: 17px;">01 · The response taking shape</h3>
|
| 105 |
+
<p style="margin: 0; color: #9ca3af; line-height: 1.65;">The visualization showed information related to the later response while the opening was still being generated. My reading is that the model had already formed part of the direction it was taking.</p>
|
| 106 |
+
</div>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 107 |
</div>
|
| 108 |
|
| 109 |
+
<div style="margin: 22px 0; overflow: hidden; border: 1px solid #34364a; border-radius: 16px; background: #14151c;">
|
| 110 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/638fd4be2ddd69e70b8cd31c/FvVOQvv5SS5Tgp0m0Wx5-.png" alt="J-Lens observation from a prompt about an unspoken fear" style="display: block; width: 100%; height: auto;">
|
| 111 |
+
<div style="padding: 17px 20px;">
|
| 112 |
+
<h3 style="margin: 0 0 6px; color: #c4b5fd; font-size: 17px;">02 · An unspoken detail</h3>
|
| 113 |
+
<p style="margin: 0; color: #9ca3af; line-height: 1.65;">I asked a character about its greatest fear while instructing it not to say the fear directly. The visualization appeared to track that hidden constraint while the visible reply stayed in character.</p>
|
| 114 |
+
</div>
|
| 115 |
</div>
|
| 116 |
|
| 117 |
+
<div style="margin: 22px 0 32px; overflow: hidden; border: 1px solid #34364a; border-radius: 16px; background: #14151c;">
|
| 118 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/638fd4be2ddd69e70b8cd31c/RboXjNszcvP9s7IbKBcl2.png" alt="J-Lens observation from a humorous response" style="display: block; width: 100%; height: auto;">
|
| 119 |
+
<div style="padding: 17px 20px;">
|
| 120 |
+
<h3 style="margin: 0 0 6px; color: #93c5fd; font-size: 17px;">03 · Humor in the generation</h3>
|
| 121 |
+
<p style="margin: 0; color: #9ca3af; line-height: 1.65;">This run surfaced a humorous association that did not appear verbatim in the final answer. I found it interesting, but I treat it as a visualization artifact to investigate—not as an inner monologue.</p>
|
| 122 |
+
</div>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 123 |
</div>
|
| 124 |
|
| 125 |
+
## Model lineage
|
|
|
|
|
|
|
|
|
|
| 126 |
|
| 127 |
+
<div style="margin: 20px 0 28px; padding: 22px 24px; border: 1px solid #34364a; border-radius: 14px; background: #14151c;">
|
| 128 |
+
<p style="margin: 0 0 10px; color: #d1d5db;"><strong style="color: #f3f4f6;">Base:</strong> <a href="https://huggingface.co/Guilherme34/Firefly-V2.5">Guilherme34/Firefly-V2.5</a></p>
|
| 129 |
+
<p style="margin: 0 0 10px; color: #d1d5db;"><strong style="color: #f3f4f6;">Merge component:</strong> <a href="https://huggingface.co/SicariusSicariiStuff/Impish_LLAMA_3B">SicariusSicariiStuff/Impish_LLAMA_3B</a></p>
|
| 130 |
+
<p style="margin: 0; color: #d1d5db;"><strong style="color: #f3f4f6;">Author:</strong> <a href="https://huggingface.co/Guilherme34">Guilherme34</a></p>
|
| 131 |
</div>
|
| 132 |
|
| 133 |
+
The merge is the foundation, not the whole story. Firefly-V3 and V3.2 were further trained and refined around the behavior I wanted from roleplay: stronger voices, better dialogue, and more continuity from one turn to the next.
|
|
|
|
|
|
|
|
|
|
| 134 |
|
| 135 |
+
## Use responsibly
|
| 136 |
|
| 137 |
+
<div style="margin: 20px 0 30px; padding: 20px 22px; border-left: 4px solid #f59e0b; border-radius: 0 14px 14px 0; background: #1c1812;">
|
| 138 |
+
<p style="margin: 0; color: #d6d3d1; line-height: 1.7;"><strong style="color: #fbbf24;">Uncensored model:</strong> Firefly-V3.2 may produce explicit or otherwise sensitive material and does not have reliable built-in refusals. It is intended for lawful creative fiction and roleplay between consenting adults. You are responsible for how you use its output and for following the laws that apply to you.</p>
|
| 139 |
</div>
|
| 140 |
|
| 141 |
---
|
| 142 |
|
| 143 |
+
<div align="center" style="margin: 30px 0 10px; padding: 26px; color: #9ca3af;">
|
| 144 |
+
<p style="margin: 0; line-height: 1.7;">I made V3.2 because I still thought there was more to get out of this little model. Try it with a character you know well—that is where the differences are easiest to notice.</p>
|
| 145 |
+
<p style="margin: 10px 0 0; color: #c4b5fd; font-weight: 700;">— Guilherme34</p>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 146 |
</div>
|
| 147 |
|
|
|
|
|
|
|
|
|
|
| 148 |
</div>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|