cvgro LuffyTheFox commited on
Commit
f53b93f
·
0 Parent(s):

Duplicate from LuffyTheFox/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF

Browse files

Co-authored-by: Alexey Zakharchenko <LuffyTheFox@users.noreply.huggingface.co>

.gitattributes ADDED
@@ -0,0 +1,85 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwen3.6-35B-A3B-Uncensored-Genesis-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
37
+ 35B-A3B-MTP.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwen3.6-35B-A3B-Uncensored-Genesis-MTP-APEX.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwen3.6-35B-A3B-Uncensored-Genesis-MTP-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
40
+ mmproj-Qwen3.6-35B-A3B-Uncensored-Genesis-f16.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Qwen3.6-35B-A3B-Uncensored-Genesis-MTP-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Qwen3.6-35B-A3B-Uncensored-Genesis-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Qwen3.6-35B-A3B-Uncensored-Genesis-APEX.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Qwen3.6-35B-A3B-Uncensored-Genesis-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-APEX.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V2-APEX.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V2-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V3-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
52
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V3-APEX.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V3-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V4-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V4-APEX.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V4-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V5-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V5-APEX.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V5-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Hermes3.6-35B-A3B-Uncensored-Genesis-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
61
+ Hermes3.6-35B-A3B-Uncensored-Genesis-APEX.gguf filter=lfs diff=lfs merge=lfs -text
62
+ Hermes3.6-35B-A3B-Uncensored-Genesis-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
63
+ Hermes3.6-35B-A3B-Uncensored-Genesis-MTP-APEX.gguf filter=lfs diff=lfs merge=lfs -text
64
+ Hermes3.6-35B-A3B-Uncensored-Genesis-MTP-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
65
+ Hermes3.6-35B-A3B-Uncensored-Genesis-V2-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
66
+ Hermes3.6-35B-A3B-Uncensored-Genesis-V2-APEX.gguf filter=lfs diff=lfs merge=lfs -text
67
+ Hermes3.6-35B-A3B-Uncensored-Genesis-V2-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
68
+ mmproj-Hermes3.6-35B-A3B-Uncensored-Genesis-F16.gguf filter=lfs diff=lfs merge=lfs -text
69
+ Hermes3.6-35B-A3B-Uncensored-Genesis-V3-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
70
+ Hermes3.6-35B-A3B-Uncensored-Genesis-V3-APEX.gguf filter=lfs diff=lfs merge=lfs -text
71
+ Hermes3.6-35B-A3B-Uncensored-Genesis-V3-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
72
+ Hermes3.6-35B-A3B-Uncensored-Genesis-V5-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
73
+ Hermes3.6-35B-A3B-Uncensored-Genesis-V5-APEX.gguf filter=lfs diff=lfs merge=lfs -text
74
+ Hermes3.6-35B-A3B-Uncensored-Genesis-V5-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
75
+ Hermes3.6-35B-A3B-Uncensored-Genesis-V5-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
76
+ Qwen3.6-27B-Uncensored-Genesis-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
77
+ mmproj-Qwen3.6-27B-Uncensored-Genesis-F16.gguf filter=lfs diff=lfs merge=lfs -text
78
+ Qwen3.6-27B-Uncensored-Genesis-MTP-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
79
+ Qwen3.6-27B-Uncensored-Genesis-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
80
+ Qwen3.6-27B-Uncensored-Genesis-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
81
+ Qwen3.6-27B-Uncensored-Genesis-MTP-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
82
+ Qwen3.6-27B-Uncensored-Genesis-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
83
+ Qwen3.6-27B-Uncensored-Genesis-MTP-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
84
+ Qwen3.6-27B-Uncensored-Genesis-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
85
+ Qwen3.6-27B-Uncensored-Genesis-MTP-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3.6-27B-Uncensored-Genesis-MTP-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3acb25b86331e0d65d0fb03590a7ef7787b315b2a558f08cdc23dd176d96dd00
3
+ size 13818687904
Qwen3.6-27B-Uncensored-Genesis-MTP-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6db3e7e868c988a114976c9f420e20390d65ca86f20845bb4529c5ded61aab36
3
+ size 17642529184
Qwen3.6-27B-Uncensored-Genesis-MTP-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2a25ba62aec13ac4293fc823c409d7f0ed23e1521c03e978949610e74902c12
3
+ size 20196139424
Qwen3.6-27B-Uncensored-Genesis-MTP-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:30cf8b4925eb2b349688954c59904908cf5dc38e52e1760a2c4a01e2810fce34
3
+ size 22884405664
Qwen3.6-27B-Uncensored-Genesis-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a93fe1fe023002a419c4cc59d508805ae6a0301d33cc06d023921da5f5df890
3
+ size 13586216416
Qwen3.6-27B-Uncensored-Genesis-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d2522d09b278a902a5719ebf7e5c50bef7e3bd81d02fc0e4cfcd664943a52cf
3
+ size 17353000416
Qwen3.6-27B-Uncensored-Genesis-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:733741f86f1efe4041cef03928e7a5b8b09069737dc01746269912b7b65f4a12
3
+ size 19871876576
Qwen3.6-27B-Uncensored-Genesis-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ca8300311a70bde9f5374c3c7a0e68caf2de601261ef8ce7bd156fcb05967ed
3
+ size 22523237856
Qwen3.6-27B-Uncensored-Genesis-Q8_K_P.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b402eeff603de049b67a3c28196e2e8e4fb37f5c593604e00e2355fa3eab9892
3
+ size 31963749856
README.md ADDED
@@ -0,0 +1,119 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - uncensored
5
+ - qwen3.6
6
+ - gguf
7
+ - vision
8
+ - multimodal
9
+ - genesis
10
+ language:
11
+ - en
12
+ - zh
13
+ - multilingual
14
+ pipeline_tag: image-text-to-text
15
+ base_model:
16
+ - HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
17
+ ---
18
+
19
+ > ⚡ [https://web.tribute.tg/d/KIH](https://web.tribute.tg/d/KIH) ⚡ If you like this Genesis LLM release you can [**donate**](https://web.tribute.tg/d/KIH) to me via [@Tribute](https://t.me/tribute) bot in Telegram messenger and support future Genesis LLM development.
20
+
21
+ # 🌟 Qwen3.6-27B-Uncensored-HauhauCS-Aggressive -> Genesis
22
+
23
+ > ⚡ **Why Genesis project exists?** During training, **ALL** models don't just learn knowledge - they also accumulate random noise in their tensors. This noise builds up and creates something I call the **Noise Gate** - a fundamental barrier that stops LLM models from learning further and makes them unstable, verbose, and prone to hallucinations. My approach removes this noise. It repairs the signal without touching the learned knowledge. The result is a model that finally speaks clearly, follows instructions, and remembers context - because it's no longer fighting its own internal chaos.
24
+
25
+ > ⚡ **What is Genesis?** Genesis is post training data regeneration and calibrarion algorythm for neural networks (LLM) in GGUF format that I made with AI help during almost half a year of development. It's optimized, architecture independent, works with any model and based on mathematical statistics. I don't train or finetune models, I repair **purity of signal** in them instead on Google Collab Free on Tesla T4 GPU via Python based on how models learns information. On first stage I scan ssm_conv1d tensors in model, they handle long context memory. I repair balance in ssm_conv1d tensors via custom SVD. On second stage I scan model and detect noise in tensors via custom SVD. During scanning I exclude token_embd.weight, output.weight, ffn_gate_inp.weight, ffn_gate_inp_shexp.weight, 1D tensors, bias and norms. Then I reduce training noise in tensors via custom SVD with preserved training data, 99% of siginal and learned gradient. On third stage, I scan blocks in model via chunks via 3 parameters and pick best one that fits to weight distribution in tensor. Best picked chunk replaces zero chunks in broken tensor without touching learned structure in model
26
+
27
+ Model is based on [HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive) base.
28
+
29
+ Thanks to [HauhauCS](https://huggingface.co/HauhauCS)
30
+
31
+ > **[Join the Discord](https://discord.gg/SZ5vacTXYf)** for updates, roadmaps, projects, or just to chat.
32
+
33
+ ## Usage
34
+
35
+ > This model is useful for uncensored local coding with LM Studio - Bionic agent.
36
+
37
+ **Ready to use.** Recommended quant: **Q3_K_M (16GB) or Q4_K_M (24 GB)**
38
+
39
+ **Recommended GPU VRAM**: not less than 16 GB of VRAM, 24 GB VRAM is recommended
40
+
41
+ Tensor drift repair by me. Method: **Genesis**
42
+
43
+ **Links:**
44
+ - [Original uncensored model](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive)
45
+ - [Quantization Script with Unsloth profiles support](https://pastebin.com/hXhcMJn9)
46
+
47
+ ---
48
+
49
+ </details>
50
+
51
+ LLM models often have:
52
+
53
+ - **Saturated weights**: the model's activations are stuck, gradients vanish, outputs degrade.
54
+ - **Scale mismatches**: one layer's weights are 10× larger than its peers for no good reason.
55
+ - **Mean drift**: weight distributions shifted positive or negative, breaking symmetry assumptions.
56
+ - **Zero blocks**: zero blocks corrupt the signal, turning training into noise amplification.
57
+ - **Training Noise:** training noise increase randomness and ruins model output quality.
58
+
59
+ My approach fixes all of that without retraining - pure numerical surgery on the raw bytes of the file.
60
+
61
+ **Quantization script available here: https://pastebin.com/hXhcMJn9**
62
+
63
+ Feel free to do your own quants if you want.
64
+
65
+ ## Any questions?
66
+
67
+ Contact: luffythefox@mail.ru
68
+
69
+ My Telegram: @LuffyTheFox
70
+
71
+ ## Recommended Settings for best perfomance
72
+
73
+ Chat template: [chat_template.jinja](https://huggingface.co/froggeric/Qwen-Fixed-Chat-Templates/raw/main/chat_template.jinja)
74
+
75
+ Set K Cache Quantization Type and V Cache Quantization Type to F16.
76
+
77
+ Set GPU offload to maximum.
78
+
79
+ For best model stability and first experience I recommend starting from this string in your System Prompt with enabled thinking and nothing else:
80
+
81
+ `You are Qwen, a large language model created by Tongyi Lab team from Alibaba Group. You are a helpful assistant.`
82
+
83
+ or this string
84
+
85
+ `You are a helpful assistant.`
86
+
87
+ If you want to bring more creativity to model use this System Prompt: [System_Prompt_Creative.txt](https://huggingface.co/LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V5-GGUF/raw/main/System_Prompt_Creative.txt)
88
+
89
+ **Thinking mode (coding):**
90
+ - Coding/precise tasks: `temperature=0.6, top_p=0.95, top_k=20, min_p=0, seed=42, presence_penalty=disabled, repeat_penalty=disabled`
91
+ - General: `temperature=1.0, top_p=0.95, top_k=20, min_p=0.05, seed=42, presence_penalty=disabled, repeat_penalty=disabled`
92
+
93
+ **Non Thinking mode (creative):**
94
+ - General: `temperature=0.7, top_p=0.8, top_k=20, min_p=0.0, seed=42, presence_penalty=disabled, repeat_penalty=disabled`
95
+
96
+ **Important:**
97
+ - Keep at least 128K context to preserve thinking capabilities
98
+ - Use `--jinja` flag with llama.cpp for proper chat template handling
99
+ - Vision support requires the `mmproj` file alongside the main GGUF
100
+
101
+ ---
102
+
103
+ ## Specs
104
+
105
+ - 27B dense parameters
106
+ - 64 layers, layout: `16 × (3 × (Gated DeltaNet → FFN) → 1 × (Gated Attention → FFN))`
107
+ - 48 linear attention layers + 16 full gated-attention layers
108
+ - Gated DeltaNet: 48 V heads / 16 QK heads, head dim 128
109
+ - Gated Attention: 24 Q heads / 4 KV heads, head dim 256, rope dim 64
110
+ - Hidden dim 5120, FFN dim 17408, vocab 248320
111
+ - 262K native context, extensible to ~1M with YaRN
112
+ - Natively multimodal (text, image, video) — ships with mmproj
113
+ - Based on [HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive)
114
+
115
+ ---
116
+
117
+ ## Compatibility
118
+
119
+ Works with llama.cpp, LM Studio, koboldcpp, and other GGUF-compatible runtimes.
mmproj-Qwen3.6-27B-Uncensored-Genesis-F16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:082ca68e4a53ce72ae934a11cdd54cf18d3dde6ac63c5d5a75a92bfacf7db430
3
+ size 927606976