Ateron commited on
Commit
7117da5
·
verified ·
1 Parent(s): a25da5c

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +87 -0
README.md CHANGED
@@ -1,3 +1,90 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - creative-writing
7
+ - storytelling
8
+ base_model:
9
+ - google/gemma-4-31B-it
10
+ - nbeerbower/Gemma4-Gutenberg-31B
11
+ - Gryphe/Gemma-4-31B-StyleTune
12
+ - bgg1996/Melinoe-Gemma4-31B-VL
13
+ model_creator: Blazed-Forge
14
+ pipeline_tag: text-generation
15
+ quantized_by: f16
16
+ language:
17
+ - en
18
  ---
19
+
20
+ <div style="background: linear-gradient(120deg, #0a0a0c 0%, #1a1a24 45%, #1f0d2b 100%); color: #e2e4e9; padding: 30px; border-radius: 12px; border: 4px solid #000000; box-shadow: 0 8px 25px rgba(0,0,0,0.8);">
21
+
22
+ <h1 align="center" style="color: #d896ff; text-shadow: 1px 1px 2px black;">🖋️ Novelist</h1>
23
+
24
+ <p align="center">
25
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/6390f888de25f9eda571b0f2/oPF6_oukddUGG0dxYXeLK.png" width="100%" alt="Novelist AI Persona" style="border-radius: 8px; border: 2px solid #000000; box-shadow: 0 4px 15px rgba(0,0,0,0.6);">
26
+ </p>
27
+
28
+ <p align="center" style="font-style: italic; color: #bca0dc; margin-top: 15px; margin-bottom: 25px; font-size: 1.15em; text-shadow: 1px 1px 3px rgba(0,0,0,0.5);">
29
+ "For relaxed minds and calm stories"
30
+ </p>
31
+
32
+ <h2 style="color: #c77dff; border-bottom: 1px solid #7a6b8c; padding-bottom: 8px; margin-top: 30px;">📌 Overview</h2>
33
+
34
+ **Novelist** was a simple merge idea that aimed to write long descriptions, that would not feel too stuttery or flowery. I wanted to see prose that would be rich and at the same time not spill unnecessary water.
35
+
36
+ <h2 style="color: #c77dff; border-bottom: 1px solid #7a6b8c; padding-bottom: 8px; margin-top: 30px;">🗒️ Merged models</h2>
37
+
38
+ There are models that I used and why:
39
+
40
+ | Component Model | Primary Contribution |
41
+ | :--- | :--- |
42
+ | **`nbeerbower/Gemma4-Gutenberg-31B`** | This is what gives it a voice. Novel-like style that I personally love a lot. |
43
+ | **`Gryphe/Gemma-4-31B-StyleTune`** | This, as many people said, brings non-sloppy prose and fresh replies. |
44
+ | **`bgg1996/Melinoe-Gemma4-31B-VL`** | This one I found very chaotic on it's own, but with surprising turns. So I used it as spicy material. |
45
+
46
+ <br>
47
+
48
+ <h3 style="color: #bca0dc; margin-top: 15px;">⚙️ Mergekit Configuration</h3>
49
+
50
+ Below is the exact `mergekit_config.yml` recipe used to synthesize this model:
51
+
52
+ <details>
53
+ <summary><b style="cursor: pointer; color: #d896ff;">Click to expand Merge Configuration</b></summary>
54
+
55
+ ```yaml
56
+ merge_method: dare_ties
57
+ base_model: F:\AI\Merge\Gemma-4-it
58
+ tokenizer_source: union
59
+ parameters:
60
+ lambda: 1.0
61
+ dtype: bfloat16
62
+ models:
63
+ - model: F:\AI\Merge\G4-Gutenberg
64
+ parameters:
65
+ density: [0.40, 0.40, 0.40, 0.40, 0.40]
66
+ weight: [0.40, 0.40, 0.40, 0.40, 0.40]
67
+
68
+ - model: F:\AI\Merge\StyleTune
69
+ parameters:
70
+ density: [0.35, 0.35, 0.35, 0.35, 0.35]
71
+ weight: [0.40, 0.40, 0.40, 0.40, 0.40]
72
+
73
+ - model: F:\AI\Merge\Melinoe
74
+ parameters:
75
+ density: [0.25, 0.25, 0.25, 0.25, 0.25]
76
+ weight: [0.20, 0.20, 0.20, 0.20, 0.20]
77
+ ```
78
+
79
+ </details>
80
+
81
+ <h2 style="color: #c77dff; border-bottom: 1px solid #7a6b8c; padding-bottom: 8px; margin-top: 30px;">🤝 Special Thanks</h2>
82
+
83
+ <ul style="color: #e2e4e9; line-height: 1.6;">
84
+ <li><strong>Google DeepMind:</strong> For providing the base model.</li>
85
+ <li><strong>The Open-Source Community:</strong> Creators and all their fine-tuned models that were used in the merge.</li>
86
+ <li><strong>Mergekit Fork:</strong> Zerofata - For making mergekit work.</li>
87
+ <li><strong>To Nimbz:</strong> <a href="https://huggingface.co/Nimbz" style="color: #d896ff; text-decoration: none;">This fella</a> for being a smart fella and assisting with advice.</li>
88
+ </ul>
89
+
90
+ </div>