Image-Text-to-Text
GGUF
English
Chinese
multilingual
uncensored
qwen3.6
vision
multimodal
genesis
imatrix
conversational
Instructions to use cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
Use Docker
docker model run hf.co/cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
- Ollama
How to use cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF with Ollama:
ollama run hf.co/cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
- Unsloth Desktop
- Pi
How to use cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF with Docker Model Runner:
docker model run hf.co/cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
- Lemonade
How to use cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "cvgro/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Commit ·
f53b93f
0
Parent(s):
Duplicate from LuffyTheFox/Qwen3.6-27B-Uncensored-Genesis-MTP-GGUF
Browse filesCo-authored-by: Alexey Zakharchenko <LuffyTheFox@users.noreply.huggingface.co>
- .gitattributes +85 -0
- Qwen3.6-27B-Uncensored-Genesis-MTP-Q3_K_M.gguf +3 -0
- Qwen3.6-27B-Uncensored-Genesis-MTP-Q4_K_M.gguf +3 -0
- Qwen3.6-27B-Uncensored-Genesis-MTP-Q5_K_M.gguf +3 -0
- Qwen3.6-27B-Uncensored-Genesis-MTP-Q6_K.gguf +3 -0
- Qwen3.6-27B-Uncensored-Genesis-Q3_K_M.gguf +3 -0
- Qwen3.6-27B-Uncensored-Genesis-Q4_K_M.gguf +3 -0
- Qwen3.6-27B-Uncensored-Genesis-Q5_K_M.gguf +3 -0
- Qwen3.6-27B-Uncensored-Genesis-Q6_K.gguf +3 -0
- Qwen3.6-27B-Uncensored-Genesis-Q8_K_P.gguf +3 -0
- README.md +119 -0
- mmproj-Qwen3.6-27B-Uncensored-Genesis-F16.gguf +3 -0
.gitattributes
ADDED
|
@@ -0,0 +1,85 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
| 2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
| 3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
| 7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
| 10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
| 11 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
| 12 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
| 13 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
| 14 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
| 17 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 18 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 19 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
| 20 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
| 21 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
| 22 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 23 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 24 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
| 25 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 26 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
| 27 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
| 28 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
| 29 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
| 30 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
| 31 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
| 32 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
| 33 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
Qwen3.6-35B-A3B-Uncensored-Genesis-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
35B-A3B-MTP.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
Qwen3.6-35B-A3B-Uncensored-Genesis-MTP-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
Qwen3.6-35B-A3B-Uncensored-Genesis-MTP-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
mmproj-Qwen3.6-35B-A3B-Uncensored-Genesis-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
Qwen3.6-35B-A3B-Uncensored-Genesis-MTP-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
Qwen3.6-35B-A3B-Uncensored-Genesis-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 43 |
+
Qwen3.6-35B-A3B-Uncensored-Genesis-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 44 |
+
Qwen3.6-35B-A3B-Uncensored-Genesis-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 48 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V2-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 50 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V2-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 51 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V3-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 52 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V3-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 53 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V3-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 54 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V4-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 55 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V4-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 56 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V4-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 57 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V5-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 58 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V5-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 59 |
+
Qwen3.6-35B-A3B-Uncensored-Claude-Genesis-V5-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 60 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
|
| 61 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 62 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 63 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-MTP-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 64 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-MTP-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 65 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-V2-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
|
| 66 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-V2-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 67 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-V2-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 68 |
+
mmproj-Hermes3.6-35B-A3B-Uncensored-Genesis-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 69 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-V3-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
|
| 70 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-V3-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 71 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-V3-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 72 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-V5-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
|
| 73 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-V5-APEX.gguf filter=lfs diff=lfs merge=lfs -text
|
| 74 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-V5-APEX-Compact.gguf filter=lfs diff=lfs merge=lfs -text
|
| 75 |
+
Hermes3.6-35B-A3B-Uncensored-Genesis-V5-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
| 76 |
+
Qwen3.6-27B-Uncensored-Genesis-Q8_K_P.gguf filter=lfs diff=lfs merge=lfs -text
|
| 77 |
+
mmproj-Qwen3.6-27B-Uncensored-Genesis-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
| 78 |
+
Qwen3.6-27B-Uncensored-Genesis-MTP-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 79 |
+
Qwen3.6-27B-Uncensored-Genesis-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
| 80 |
+
Qwen3.6-27B-Uncensored-Genesis-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 81 |
+
Qwen3.6-27B-Uncensored-Genesis-MTP-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 82 |
+
Qwen3.6-27B-Uncensored-Genesis-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 83 |
+
Qwen3.6-27B-Uncensored-Genesis-MTP-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 84 |
+
Qwen3.6-27B-Uncensored-Genesis-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
| 85 |
+
Qwen3.6-27B-Uncensored-Genesis-MTP-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
Qwen3.6-27B-Uncensored-Genesis-MTP-Q3_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3acb25b86331e0d65d0fb03590a7ef7787b315b2a558f08cdc23dd176d96dd00
|
| 3 |
+
size 13818687904
|
Qwen3.6-27B-Uncensored-Genesis-MTP-Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6db3e7e868c988a114976c9f420e20390d65ca86f20845bb4529c5ded61aab36
|
| 3 |
+
size 17642529184
|
Qwen3.6-27B-Uncensored-Genesis-MTP-Q5_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2a25ba62aec13ac4293fc823c409d7f0ed23e1521c03e978949610e74902c12
|
| 3 |
+
size 20196139424
|
Qwen3.6-27B-Uncensored-Genesis-MTP-Q6_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:30cf8b4925eb2b349688954c59904908cf5dc38e52e1760a2c4a01e2810fce34
|
| 3 |
+
size 22884405664
|
Qwen3.6-27B-Uncensored-Genesis-Q3_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9a93fe1fe023002a419c4cc59d508805ae6a0301d33cc06d023921da5f5df890
|
| 3 |
+
size 13586216416
|
Qwen3.6-27B-Uncensored-Genesis-Q4_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4d2522d09b278a902a5719ebf7e5c50bef7e3bd81d02fc0e4cfcd664943a52cf
|
| 3 |
+
size 17353000416
|
Qwen3.6-27B-Uncensored-Genesis-Q5_K_M.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:733741f86f1efe4041cef03928e7a5b8b09069737dc01746269912b7b65f4a12
|
| 3 |
+
size 19871876576
|
Qwen3.6-27B-Uncensored-Genesis-Q6_K.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8ca8300311a70bde9f5374c3c7a0e68caf2de601261ef8ce7bd156fcb05967ed
|
| 3 |
+
size 22523237856
|
Qwen3.6-27B-Uncensored-Genesis-Q8_K_P.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b402eeff603de049b67a3c28196e2e8e4fb37f5c593604e00e2355fa3eab9892
|
| 3 |
+
size 31963749856
|
README.md
ADDED
|
@@ -0,0 +1,119 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
tags:
|
| 4 |
+
- uncensored
|
| 5 |
+
- qwen3.6
|
| 6 |
+
- gguf
|
| 7 |
+
- vision
|
| 8 |
+
- multimodal
|
| 9 |
+
- genesis
|
| 10 |
+
language:
|
| 11 |
+
- en
|
| 12 |
+
- zh
|
| 13 |
+
- multilingual
|
| 14 |
+
pipeline_tag: image-text-to-text
|
| 15 |
+
base_model:
|
| 16 |
+
- HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive
|
| 17 |
+
---
|
| 18 |
+
|
| 19 |
+
> ⚡ [https://web.tribute.tg/d/KIH](https://web.tribute.tg/d/KIH) ⚡ If you like this Genesis LLM release you can [**donate**](https://web.tribute.tg/d/KIH) to me via [@Tribute](https://t.me/tribute) bot in Telegram messenger and support future Genesis LLM development.
|
| 20 |
+
|
| 21 |
+
# 🌟 Qwen3.6-27B-Uncensored-HauhauCS-Aggressive -> Genesis
|
| 22 |
+
|
| 23 |
+
> ⚡ **Why Genesis project exists?** During training, **ALL** models don't just learn knowledge - they also accumulate random noise in their tensors. This noise builds up and creates something I call the **Noise Gate** - a fundamental barrier that stops LLM models from learning further and makes them unstable, verbose, and prone to hallucinations. My approach removes this noise. It repairs the signal without touching the learned knowledge. The result is a model that finally speaks clearly, follows instructions, and remembers context - because it's no longer fighting its own internal chaos.
|
| 24 |
+
|
| 25 |
+
> ⚡ **What is Genesis?** Genesis is post training data regeneration and calibrarion algorythm for neural networks (LLM) in GGUF format that I made with AI help during almost half a year of development. It's optimized, architecture independent, works with any model and based on mathematical statistics. I don't train or finetune models, I repair **purity of signal** in them instead on Google Collab Free on Tesla T4 GPU via Python based on how models learns information. On first stage I scan ssm_conv1d tensors in model, they handle long context memory. I repair balance in ssm_conv1d tensors via custom SVD. On second stage I scan model and detect noise in tensors via custom SVD. During scanning I exclude token_embd.weight, output.weight, ffn_gate_inp.weight, ffn_gate_inp_shexp.weight, 1D tensors, bias and norms. Then I reduce training noise in tensors via custom SVD with preserved training data, 99% of siginal and learned gradient. On third stage, I scan blocks in model via chunks via 3 parameters and pick best one that fits to weight distribution in tensor. Best picked chunk replaces zero chunks in broken tensor without touching learned structure in model
|
| 26 |
+
|
| 27 |
+
Model is based on [HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive) base.
|
| 28 |
+
|
| 29 |
+
Thanks to [HauhauCS](https://huggingface.co/HauhauCS)
|
| 30 |
+
|
| 31 |
+
> **[Join the Discord](https://discord.gg/SZ5vacTXYf)** for updates, roadmaps, projects, or just to chat.
|
| 32 |
+
|
| 33 |
+
## Usage
|
| 34 |
+
|
| 35 |
+
> This model is useful for uncensored local coding with LM Studio - Bionic agent.
|
| 36 |
+
|
| 37 |
+
**Ready to use.** Recommended quant: **Q3_K_M (16GB) or Q4_K_M (24 GB)**
|
| 38 |
+
|
| 39 |
+
**Recommended GPU VRAM**: not less than 16 GB of VRAM, 24 GB VRAM is recommended
|
| 40 |
+
|
| 41 |
+
Tensor drift repair by me. Method: **Genesis**
|
| 42 |
+
|
| 43 |
+
**Links:**
|
| 44 |
+
- [Original uncensored model](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive)
|
| 45 |
+
- [Quantization Script with Unsloth profiles support](https://pastebin.com/hXhcMJn9)
|
| 46 |
+
|
| 47 |
+
---
|
| 48 |
+
|
| 49 |
+
</details>
|
| 50 |
+
|
| 51 |
+
LLM models often have:
|
| 52 |
+
|
| 53 |
+
- **Saturated weights**: the model's activations are stuck, gradients vanish, outputs degrade.
|
| 54 |
+
- **Scale mismatches**: one layer's weights are 10× larger than its peers for no good reason.
|
| 55 |
+
- **Mean drift**: weight distributions shifted positive or negative, breaking symmetry assumptions.
|
| 56 |
+
- **Zero blocks**: zero blocks corrupt the signal, turning training into noise amplification.
|
| 57 |
+
- **Training Noise:** training noise increase randomness and ruins model output quality.
|
| 58 |
+
|
| 59 |
+
My approach fixes all of that without retraining - pure numerical surgery on the raw bytes of the file.
|
| 60 |
+
|
| 61 |
+
**Quantization script available here: https://pastebin.com/hXhcMJn9**
|
| 62 |
+
|
| 63 |
+
Feel free to do your own quants if you want.
|
| 64 |
+
|
| 65 |
+
## Any questions?
|
| 66 |
+
|
| 67 |
+
Contact: luffythefox@mail.ru
|
| 68 |
+
|
| 69 |
+
My Telegram: @LuffyTheFox
|
| 70 |
+
|
| 71 |
+
## Recommended Settings for best perfomance
|
| 72 |
+
|
| 73 |
+
Chat template: [chat_template.jinja](https://huggingface.co/froggeric/Qwen-Fixed-Chat-Templates/raw/main/chat_template.jinja)
|
| 74 |
+
|
| 75 |
+
Set K Cache Quantization Type and V Cache Quantization Type to F16.
|
| 76 |
+
|
| 77 |
+
Set GPU offload to maximum.
|
| 78 |
+
|
| 79 |
+
For best model stability and first experience I recommend starting from this string in your System Prompt with enabled thinking and nothing else:
|
| 80 |
+
|
| 81 |
+
`You are Qwen, a large language model created by Tongyi Lab team from Alibaba Group. You are a helpful assistant.`
|
| 82 |
+
|
| 83 |
+
or this string
|
| 84 |
+
|
| 85 |
+
`You are a helpful assistant.`
|
| 86 |
+
|
| 87 |
+
If you want to bring more creativity to model use this System Prompt: [System_Prompt_Creative.txt](https://huggingface.co/LuffyTheFox/Qwen3.6-35B-A3B-Uncensored-Genesis-Hermes-V5-GGUF/raw/main/System_Prompt_Creative.txt)
|
| 88 |
+
|
| 89 |
+
**Thinking mode (coding):**
|
| 90 |
+
- Coding/precise tasks: `temperature=0.6, top_p=0.95, top_k=20, min_p=0, seed=42, presence_penalty=disabled, repeat_penalty=disabled`
|
| 91 |
+
- General: `temperature=1.0, top_p=0.95, top_k=20, min_p=0.05, seed=42, presence_penalty=disabled, repeat_penalty=disabled`
|
| 92 |
+
|
| 93 |
+
**Non Thinking mode (creative):**
|
| 94 |
+
- General: `temperature=0.7, top_p=0.8, top_k=20, min_p=0.0, seed=42, presence_penalty=disabled, repeat_penalty=disabled`
|
| 95 |
+
|
| 96 |
+
**Important:**
|
| 97 |
+
- Keep at least 128K context to preserve thinking capabilities
|
| 98 |
+
- Use `--jinja` flag with llama.cpp for proper chat template handling
|
| 99 |
+
- Vision support requires the `mmproj` file alongside the main GGUF
|
| 100 |
+
|
| 101 |
+
---
|
| 102 |
+
|
| 103 |
+
## Specs
|
| 104 |
+
|
| 105 |
+
- 27B dense parameters
|
| 106 |
+
- 64 layers, layout: `16 × (3 × (Gated DeltaNet → FFN) → 1 × (Gated Attention → FFN))`
|
| 107 |
+
- 48 linear attention layers + 16 full gated-attention layers
|
| 108 |
+
- Gated DeltaNet: 48 V heads / 16 QK heads, head dim 128
|
| 109 |
+
- Gated Attention: 24 Q heads / 4 KV heads, head dim 256, rope dim 64
|
| 110 |
+
- Hidden dim 5120, FFN dim 17408, vocab 248320
|
| 111 |
+
- 262K native context, extensible to ~1M with YaRN
|
| 112 |
+
- Natively multimodal (text, image, video) — ships with mmproj
|
| 113 |
+
- Based on [HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive](https://huggingface.co/HauhauCS/Qwen3.6-27B-Uncensored-HauhauCS-Aggressive)
|
| 114 |
+
|
| 115 |
+
---
|
| 116 |
+
|
| 117 |
+
## Compatibility
|
| 118 |
+
|
| 119 |
+
Works with llama.cpp, LM Studio, koboldcpp, and other GGUF-compatible runtimes.
|
mmproj-Qwen3.6-27B-Uncensored-Genesis-F16.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:082ca68e4a53ce72ae934a11cdd54cf18d3dde6ac63c5d5a75a92bfacf7db430
|
| 3 |
+
size 927606976
|