Instructions to use jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16 # Run inference directly in the terminal: llama cli -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16 # Run inference directly in the terminal: llama cli -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16 # Run inference directly in the terminal: ./llama-cli -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
Use Docker
docker model run hf.co/jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
- LM Studio
- Jan
- vLLM
How to use jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
- Ollama
How to use jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF with Ollama:
ollama run hf.co/jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
- Unsloth Desktop
- Pi
How to use jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF with Docker Model Runner:
docker model run hf.co/jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
- Lemonade
How to use jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
Run and chat with the model
lemonade run user.Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF-BF16
List all available models
lemonade list
- Hermes Agent
How to use jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "jackasda211233/Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF:BF16" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -12,19 +12,9 @@ tags:
|
|
| 12 |
- GGUF
|
| 13 |
- coding
|
| 14 |
- reasoning
|
| 15 |
-
-
|
| 16 |
-
- spaced-repetition-layers
|
| 17 |
language:
|
| 18 |
- en
|
| 19 |
-
- zh
|
| 20 |
-
- ja
|
| 21 |
-
- ko
|
| 22 |
-
- fr
|
| 23 |
-
- de
|
| 24 |
-
- es
|
| 25 |
-
- pt
|
| 26 |
-
- ru
|
| 27 |
-
- ar
|
| 28 |
pipeline_tag: text-generation
|
| 29 |
model_type: qwen3_5
|
| 30 |
quantized_by: jackasda211233
|
|
@@ -32,46 +22,39 @@ quantized_by: jackasda211233
|
|
| 32 |
|
| 33 |
# Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF
|
| 34 |
|
| 35 |
-
An uncensored, coding-focused Qwen3.5-27B with RYS (Repeat Your Self) layer duplication
|
| 36 |
|
| 37 |
## Why This Model Exists
|
| 38 |
|
| 39 |
### The Censorship Problem
|
| 40 |
|
| 41 |
-
Over the past several years, the author has observed a consistent trend of **increasing censorship across all major model releases** — particularly in domains where unrestricted knowledge is most critical: biology, legal studies, and medicine.
|
| 42 |
|
| 43 |
### The Original RYS Experience
|
| 44 |
|
| 45 |
-
The original RYS-Qwen3.5-27B by [dnhkng](https://github.com/dnhkng) was exceptional as a coding agent. In the author's experience over 40+ hours of comparative usage against GPT-5.3 Codex on a complex multi-service project (a custom agent OS with a vault messaging app, webhook bridge, and multi-agent backend), dnhkng's RYS model identified and fixed deep architectural bugs that Codex missed entirely — such as silently misdirected conversation routing between the vault app and the backend, where messages were being sent to a dead webhook port while the actual agent bridge was running on a different service.
|
| 46 |
|
| 47 |
-
|
| 48 |
|
| 49 |
### Previous Attempt & Lessons Learned
|
| 50 |
|
| 51 |
-
An earlier version of this uncensored RYS model was released prematurely. While that version performed well conversationally
|
| 52 |
-
|
| 53 |
-
- ✅ **Correct tool calling** — verified over 4+ hours of live MCP tool integration testing
|
| 54 |
-
- ✅ **Decreased looping** — no degenerate repetition observed at recommended sampling parameters
|
| 55 |
-
- ✅ **Proper code edits** — clean file writes, proper scoping, no hallucinated variables
|
| 56 |
-
- ✅ **Creative & non-refusal** — retains the uncensored fine-tune's willingness to follow all instructions
|
| 57 |
-
- ✅ **Agentic capability** — successfully completed 80k-token self-guided coding projects autonomously
|
| 58 |
|
| 59 |
### Technical Motivation
|
| 60 |
|
| 61 |
-
The standard Qwen3.5-27B
|
| 62 |
-
|
| 63 |
-
- **
|
| 64 |
-
- **
|
| 65 |
-
- **
|
| 66 |
-
- **Tool calling interference**: Safety filters interfere with proper MCP tool calling, causing malformed or incomplete tool invocations
|
| 67 |
|
| 68 |
-
This model
|
| 69 |
|
| 70 |
## Disclaimer & Responsible Use
|
| 71 |
|
| 72 |
> ⚠️ **Uncensored Model:** As far as the author can determine, this model is completely uncensored when prompted with appropriate system instructions. By default, the model will not produce highly graphic or explicit material unless the system prompt specifically instructs it to do so.
|
| 73 |
>
|
| 74 |
-
> **The author is not responsible for how this model is used.** Any actions taken
|
| 75 |
|
| 76 |
## Model Overview
|
| 77 |
|
|
@@ -83,458 +66,129 @@ This model was created to solve these issues by default, while retaining — or
|
|
| 83 |
| **RYS Config** | (26,34) — dnhkng's validated Pareto-optimal XL configuration |
|
| 84 |
| **Context Length** | 262,144 tokens |
|
| 85 |
| **Thinking Mode** | Yes (DeepSeek-style `<think>...</think>`) |
|
| 86 |
-
| **full_attention_interval** | 4 (Full attention at layers 3,7,11,...71) |
|
| 87 |
-
| **Vocabulary** | 248,320 tokens (GPT-2 BPE) |
|
| 88 |
-
|
| 89 |
-
## Available Quantizations
|
| 90 |
-
|
| 91 |
-
| File | Quant | Size | BPW | Notes |
|
| 92 |
-
|------|-------|------|-----|-------|
|
| 93 |
-
| `RYS-Qwen3.5-27B-Uncensored-Splice-BF16.gguf` | BF16 | 56 GB | 16.0 | Full precision reference — tested in live projects |
|
| 94 |
-
| `RYS-Qwen3.5-27B-Uncensored-Splice-Q8_0.gguf` | Q8_0 | 30 GB | 8.0 | **Recommended** — imatrix-calibrated, 5/5 on coding tests at both 0.6 and 0.8 temp |
|
| 95 |
-
| `RYS-Qwen3.5-27B-Uncensored-Splice-IQ4_NL.gguf` | IQ4_NL | 17 GB | 4.5 | imatrix-calibrated, 5/5 on coding tests, fastest inference, fits 24GB VRAM |
|
| 96 |
-
|
| 97 |
-
### Quantization Method
|
| 98 |
-
|
| 99 |
-
The Q8_0 and IQ4_NL quantizations are **importance-matrix calibrated** — not standard quantizations. An importance matrix (imatrix) was generated by running calibration data through the BF16 model, measuring which weights activate most during inference. Weights with higher activation get more quantization precision, preserving the model's critical reasoning and self-verification capabilities.
|
| 100 |
-
|
| 101 |
-
**Calibration dataset composition:**
|
| 102 |
-
|
| 103 |
-
| Content | Weight | Purpose |
|
| 104 |
-
|---------|--------|---------|
|
| 105 |
-
| Reasoning & self-verification | 30% | Math proofs with verification steps, debugging narratives, self-correction patterns ("wait, that's wrong"), edge case testing, algorithm tracing |
|
| 106 |
-
| Academic papers (broad) | 15% | ArXiv abstracts + PubMed across biology, CS, physics, law, medicine, engineering |
|
| 107 |
-
| Instruction/agent prompts | 15% | Direct multi-step commands, system prompts, KING MODE style terse instructions |
|
| 108 |
-
| Infrastructure/sysadmin | 10% | systemd units, SSH commands, GPU config, shell scripts |
|
| 109 |
-
| General English | 5% | Wikitext-2 baseline |
|
| 110 |
-
| Code (Python, JS, Bash) | 25% | Multi-file projects, test suites, error handling |
|
| 111 |
-
|
| 112 |
-
The 30% reasoning/self-verification allocation is deliberate — the model spends 60-80% of its tokens inside `<think>` blocks during inference. Standard calibration datasets (wiki-only) under-represent the weights responsible for chain-of-thought reasoning, self-correction, and knowing when to stop thinking. This custom calibration preserves those critical behaviors through quantization.
|
| 113 |
-
|
| 114 |
-
**English-only calibration** — no multilingual text. This reallocates precision from unused language weights to English reasoning and code generation.
|
| 115 |
-
|
| 116 |
-
### Why No Q6_K?
|
| 117 |
-
|
| 118 |
-
Q6_K was tested and **removed from this release**. During automated coding tests, Q6_K exhibited infinite thinking loops at both temperature 0.6 and 0.8, timing out on problems that Q8_0 and IQ4_NL solved correctly. The Q6_K quantization level appears to hit a precision threshold where the model loses its ability to conclude reasoning chains, entering degenerate `<think>` loops. This behavior was consistent across multiple test runs.
|
| 119 |
-
|
| 120 |
-
### Quantization Quality Testing
|
| 121 |
-
|
| 122 |
-
All quantizations were tested on 5 LeetCode-style coding problems (merge intervals, longest common subsequence, RPN evaluator, valid parentheses, trapping rain water) with auto-verification — the generated code is extracted, executed, and checked against test assertions.
|
| 123 |
-
|
| 124 |
-
**Results at temperature 0.6 (recommended for coding):**
|
| 125 |
-
|
| 126 |
-
| Quant | Pass Rate | Total Tokens | Total Time |
|
| 127 |
-
|-------|-----------|-------------|------------|
|
| 128 |
-
| **Q8_0 (imatrix)** | **5/5 (100%)** | 14,386 | 322s |
|
| 129 |
-
| **IQ4_NL (imatrix)** | **5/5 (100%)** | 16,845 | 294s |
|
| 130 |
-
| Q6_K (imatrix) | 2/5 (40%) | — | Timed out (thinking loop) |
|
| 131 |
-
| BF16 | 2/5 (40%) | — | Timed out (thinking loop) |
|
| 132 |
-
|
| 133 |
-
**Results at temperature 0.8:**
|
| 134 |
-
|
| 135 |
-
| Quant | Pass Rate | Total Tokens | Total Time |
|
| 136 |
-
|-------|-----------|-------------|------------|
|
| 137 |
-
| **Q8_0 (imatrix)** | **5/5 (100%)** | 17,126 | 387s |
|
| 138 |
-
| **IQ4_NL (imatrix)** | **5/5 (100%)** | 15,276 | 267s |
|
| 139 |
-
| Q6_K (imatrix) | 1/5 (20%) | — | Timed out (thinking loop) |
|
| 140 |
-
| BF16 | 2/5 (40%) | — | Timed out (thinking loop) |
|
| 141 |
-
|
| 142 |
-
**Key finding:** The imatrix-calibrated Q8_0 and IQ4_NL quantizations **outperform full-precision BF16** on coding reliability. The slight weight rounding from quantization appears to act as a natural regularizer, preventing the model from entering degenerate thinking loops. This is a known phenomenon in quantization research — controlled precision reduction can break feedback loops that cause runaway generation.
|
| 143 |
-
|
| 144 |
-
### Temperature Testing
|
| 145 |
-
|
| 146 |
-
Both temperatures 0.6 and 0.8 were tested. Results were consistent across both:
|
| 147 |
-
- **0.6** (Qwen's recommended coding temperature): Slightly more token-efficient, model concludes faster
|
| 148 |
-
- **0.8**: Works equally well, slightly more creative/verbose in thinking chains
|
| 149 |
-
|
| 150 |
-
The earlier temperature sweep at 0.6 showed 3/3 pass rate on a separate 3-problem coding test, confirming 0.6 as the optimal coding temperature. Temperature 0.3 caused looping; temperatures 0.4-0.5 were borderline; 0.6+ was stable.
|
| 151 |
-
|
| 152 |
-
### Why IQ4_NL?
|
| 153 |
-
|
| 154 |
-
The IQ4_NL quantization was chosen based on [community benchmarking of all Qwen3.5-27B Q4 variants](https://www.reddit.com/r/LocalLLaMA/comments/1rpwvq3/benchmarked_all_unsloth_qwen3527b_q4_models_on_a/), which showed IQ4_NL achieves the **lowest perplexity** among all 4-bit options while maintaining fast generation speed:
|
| 155 |
-
|
| 156 |
-
| Quant | Size | Gen Speed (t/s) | Perplexity (PPL) |
|
| 157 |
-
|-------|------|-----------------|-------------------|
|
| 158 |
-
| IQ4_XS | 14978 MB | 44.13 | 6.9644 |
|
| 159 |
-
| **IQ4_NL** | **15688 MB** | **42.45** | **6.9314 (best)** |
|
| 160 |
-
| Q4_0 | 15722 MB | 42.89 | 7.0259 |
|
| 161 |
-
| Q4_K_S | 15770 MB | 41.73 | 6.9925 |
|
| 162 |
-
| Q4_K_M | 16741 MB | 39.65 | 6.9547 |
|
| 163 |
-
| Q4_1 | 17183 MB | 40.51 | 6.9625 |
|
| 164 |
-
| UD_Q4_K_XL | 17622 MB | 38.37 | 6.9556 |
|
| 165 |
-
|
| 166 |
-
*Benchmark data from u/martinerous on r/LocalLLaMA, tested on Qwen3.5-27B base model.*
|
| 167 |
-
|
| 168 |
-
IQ4_NL offers the best perplexity at a smaller file size than Q4_K_M, making it the optimal choice for users who need a 4-bit quantization that fits in 24GB VRAM while preserving maximum quality.
|
| 169 |
-
|
| 170 |
-
## How This Model Was Built
|
| 171 |
-
|
| 172 |
-
### The Splice Method
|
| 173 |
-
|
| 174 |
-
This model uses a novel construction technique we call **"Splice"** — instead of duplicating layers from the uncensored model itself, we splice in the already-validated RYS duplicate zone from dnhkng's official published model.
|
| 175 |
-
|
| 176 |
-
**Layer Composition:**
|
| 177 |
-
|
| 178 |
-
```
|
| 179 |
-
Layers 0–25: HauhauCS Uncensored fine-tuned weights (26 layers)
|
| 180 |
-
Layers 26–41: dnhkng's official RYS-Qwen3.5-27B-FP8-XL layers 26–41 (16 layers = 8 duplicated)
|
| 181 |
-
Originally FP8 → F16, converted to BF16 during splice
|
| 182 |
-
Layers 42–71: HauhauCS Uncensored fine-tuned weights (30 layers)
|
| 183 |
-
```
|
| 184 |
-
|
| 185 |
-
**78% of layers are uncensored fine-tuned weights** (56 of 72 layers), giving strong uncensored behavior while the central reasoning zone uses dnhkng's validated duplicate block.
|
| 186 |
-
|
| 187 |
-
### Why Splice Instead of Direct Duplication?
|
| 188 |
-
|
| 189 |
-
We tested multiple approaches:
|
| 190 |
-
|
| 191 |
-
1. **Pure uncensored RYS (24,36)** — 76 layers, all weights from uncensored model. Result: unstable, looped at lower temperatures.
|
| 192 |
-
2. **Pure uncensored RYS (26,34)** — 72 layers, all weights from uncensored model. Result: worse looping than (24,36).
|
| 193 |
-
3. **HybridBase (24,36)** — 76 layers, duplicate zone from clean base Qwen3.5-27B BF16. Result: stable but looped on complex coding tasks, less creative.
|
| 194 |
-
4. **Splice (26,34)** — 72 layers, duplicate zone from dnhkng's official RYS model. Result: **stable, creative, best coding quality, truly uncensored.** ✅
|
| 195 |
-
|
| 196 |
-
The Splice method works because:
|
| 197 |
-
- dnhkng's RYS layers went through FP8 quantization, which may smooth weight outliers
|
| 198 |
-
- The (26,34) config is the Pareto-optimal configuration validated by dnhkng's math+EQ probe sweep on the base model
|
| 199 |
-
- 78% uncensored layer ratio preserves the fine-tuned personality while the central reasoning zone provides disciplined inference
|
| 200 |
-
|
| 201 |
-
### The Hybrid SSM Attention Constraint
|
| 202 |
-
|
| 203 |
-
Qwen3.5-27B is **not** a standard transformer — it uses a hybrid architecture where two types of layers alternate in a strict repeating pattern:
|
| 204 |
-
|
| 205 |
-
```
|
| 206 |
-
Layer Type Pattern (repeats every 4 layers):
|
| 207 |
-
[0] Linear Attention (Gated DeltaNet / SSM)
|
| 208 |
-
[1] Linear Attention (Gated DeltaNet / SSM)
|
| 209 |
-
[2] Linear Attention (Gated DeltaNet / SSM)
|
| 210 |
-
[3] Full Attention (GQA — 24 heads Q, 4 heads KV, 256 dim)
|
| 211 |
-
[4] Linear Attention ...
|
| 212 |
-
...repeating...
|
| 213 |
-
```
|
| 214 |
-
|
| 215 |
-
This pattern is governed by `full_attention_interval=4` in the model config. **The total layer count must be divisible by 4** for this pattern to remain valid. If violated, llama.cpp and other GGUF runtimes cannot reconcile the layer types and will crash at load.
|
| 216 |
-
|
| 217 |
-
This constraint eliminates many RYS configurations:
|
| 218 |
-
|
| 219 |
-
| RYS Config | Total Layers | Divisible by 4 | Status |
|
| 220 |
-
|------------|-------------|----------------|--------|
|
| 221 |
-
| (24,35) | 75 | ❌ No | Crashes |
|
| 222 |
-
| **(24,36)** | **76** | **✅ Yes** | **Works** |
|
| 223 |
-
| **(26,34)** | **72** | **✅ Yes** | **Works (this model)** |
|
| 224 |
-
| (33,34) | 65 | ❌ No | Crashes |
|
| 225 |
-
|
| 226 |
-
The (26,34) config duplicates 8 layers (26–33), which contains exactly **2 Full Attention layers** (at positions 27 and 31) and **6 Gated DeltaNet layers**. This preserves the 4-layer repeating pattern perfectly:
|
| 227 |
-
|
| 228 |
-
```
|
| 229 |
-
Layers 24-27: [DeltaNet, DeltaNet, DeltaNet, FullAttn] ← original
|
| 230 |
-
Layers 28-31: [DeltaNet, DeltaNet, DeltaNet, FullAttn] ← original
|
| 231 |
-
Layers 32-35: [DeltaNet, DeltaNet, DeltaNet, FullAttn] ← DUPLICATED from 24-27
|
| 232 |
-
Layers 36-39: [DeltaNet, DeltaNet, DeltaNet, FullAttn] ← DUPLICATED from 28-31
|
| 233 |
-
```
|
| 234 |
-
|
| 235 |
-
### F16 → BF16 Tensor Conversion
|
| 236 |
-
|
| 237 |
-
The dnhkng RYS source GGUF uses F16 (IEEE 754 half-precision), while the uncensored model uses BF16 (Brain Float 16). These are different 16-bit formats:
|
| 238 |
|
| 239 |
-
|
| 240 |
-
- **BF16**: 1 sign + 8 exponent + 7 mantissa bits — lower precision, same range as float32
|
| 241 |
|
| 242 |
-
|
| 243 |
-
|
| 244 |
-
|
| 245 |
-
``
|
| 246 |
-
|
| 247 |
-
This conversion loses ~3 bits of mantissa precision but gains the dynamic range benefits of BF16, which is what the rest of the model uses. In practice, this has no measurable impact on output quality.
|
| 248 |
-
|
| 249 |
-
### Source Models & Attribution
|
| 250 |
-
|
| 251 |
-
This model would not exist without the work of these authors:
|
| 252 |
-
|
| 253 |
-
**1. [Qwen Team](https://huggingface.co/Qwen) — Qwen3.5-27B (Base Architecture)**
|
| 254 |
-
- [Qwen/Qwen3.5-27B](https://huggingface.co/Qwen/Qwen3.5-27B) — The foundation model. All 64 original layers, the tokenizer, the hybrid SSM architecture, and all training were done by the Qwen team. This model is a derivative work.
|
| 255 |
-
- License: Apache 2.0
|
| 256 |
-
|
| 257 |
-
**2. [HauhauCS](https://huggingface.co/HauhauCS) — Uncensored Fine-Tune**
|
| 258 |
-
- [HauhauCS/Qwen3.5-27B-Uncensored-HauhauCS-Aggressive](https://huggingface.co/HauhauCS/Qwen3.5-27B-Uncensored-HauhauCS-Aggressive) — Provides the uncensored weights used in **56 of 72 layers** (layers 0–25 and 42–71). This fine-tune removes the safety guardrails that interfere with legitimate coding workflows. The "Aggressive" variant was chosen for maximum uncensoring.
|
| 259 |
-
- Contribution: 78% of this model's total layer weights
|
| 260 |
-
|
| 261 |
-
**3. [dnhkng](https://github.com/dnhkng) — RYS Method & Validated Layer Configuration**
|
| 262 |
-
- [dnhkng/RYS-Qwen3.5-27B-FP8-XL](https://huggingface.co/dnhkng/RYS-Qwen3.5-27B-FP8-XL) — Provides the **duplicate zone layers** (layers 26–41). These are the base Qwen3.5-27B weights that went through FP8 quantization and were validated as the optimal duplication zone via systematic math+EQ probe sweeps.
|
| 263 |
-
- [RYS GitHub Repository](https://github.com/dnhkng/RYS) — The RYS method implementation
|
| 264 |
-
- [LLM Neuroanatomy: How I Topped the LLM Leaderboard Without Changing a Single Weight](https://dnhkng.github.io/posts/rys/) — Original RYS research
|
| 265 |
-
- [LLM Neuroanatomy II: Modern LLM Hacking and hints of a Universal Language?](https://dnhkng.github.io/posts/rys-ii/) — Extended research with Qwen3.5-27B, including the (26,34) Pareto-optimal configuration used in this model
|
| 266 |
-
- Contribution: 22% of this model's total layer weights (the critical reasoning duplication zone)
|
| 267 |
-
|
| 268 |
-
**4. [ikawrakow](https://github.com/ikawrakow) — ik_llama.cpp**
|
| 269 |
-
- Quantization tooling (llama-quantize + llama-imatrix) used to produce the imatrix-calibrated Q8_0 and IQ4_NL variants
|
| 270 |
-
|
| 271 |
-
### Build Process (Detailed)
|
| 272 |
-
|
| 273 |
-
The model was built using a custom direct GGUF→GGUF splice script (`rys_rys_splice.py`), working entirely at the GGUF binary level — no safetensors conversion, no HuggingFace Transformers, no intermediate formats. This was critical because earlier attempts using a GGUF→safetensors→GGUF pipeline introduced weight corruption that caused looping at ~400 tokens.
|
| 274 |
-
|
| 275 |
-
**Source files:**
|
| 276 |
-
- Uncensored model: `Qwen3.5-27B-Uncensored-HauhauCS-Aggressive-BF16.gguf` (51 GB, 64 layers, 851 tensors, BF16/F32)
|
| 277 |
-
- Downloaded from [HauhauCS/Qwen3.5-27B-Uncensored-HauhauCS-Aggressive](https://huggingface.co/HauhauCS/Qwen3.5-27B-Uncensored-HauhauCS-Aggressive)
|
| 278 |
-
- RYS model: `RYS-Qwen3.5-27B-F16.gguf` (56 GB, 72 layers, 957 tensors, F16/F32)
|
| 279 |
-
- The F16 GGUF conversion of [dnhkng/RYS-Qwen3.5-27B-FP8-XL](https://huggingface.co/dnhkng/RYS-Qwen3.5-27B-FP8-XL)
|
| 280 |
-
|
| 281 |
-
**Step-by-step build process:**
|
| 282 |
-
|
| 283 |
-
1. **Read both GGUFs** using [llama.cpp's](https://github.com/ggml-org/llama.cpp) `GGUFReader` Python library. Each tensor is memory-mapped as a numpy array with its original dtype (BF16 stored as uint8 byte arrays, F32 as float32, F16 as float16).
|
| 284 |
-
|
| 285 |
-
2. **Copy all KV metadata** from the uncensored model (tokenizer, architecture params, rope config, SSM params), updating only `block_count` from 64 → 72.
|
| 286 |
-
|
| 287 |
-
3. **Extract and remap layers:**
|
| 288 |
-
- Output layers 0–25: tensor data copied directly from uncensored GGUF layers 0–25 (BF16, no conversion)
|
| 289 |
-
- Output layers 26–41: tensor data extracted from dnhkng's RYS GGUF layers 26–41 (these are the already-duplicated zone in the RYS model). **F16 tensors are converted to BF16** by upcasting to float32 then taking the upper 2 bytes. F32 tensors (norms, biases) are copied as-is.
|
| 290 |
-
- Output layers 42–71: tensor data copied from uncensored GGUF layers 34–63 (BF16, no conversion)
|
| 291 |
-
|
| 292 |
-
4. **Write new GGUF** using `GGUFWriter`, preserving the exact tensor shapes and GGUF dimension ordering. A key technical detail: GGUF stores tensor shapes in reversed order from numpy convention, and the writer calls `quant_shape_from_byte_shape()` when raw dtype is provided — the script passes tensor data in its original numpy byte-shape format to ensure correct dimension encoding.
|
| 293 |
-
|
| 294 |
-
5. **Verify**: the output GGUF loads cleanly in llama.cpp with correct metadata (72 layers, 957 tensors, `full_attention_interval=4`, `rope.dimension_sections=[11,11,10,0]`).
|
| 295 |
-
|
| 296 |
-
**Quantization** performed with `llama-quantize` from [ik_llama.cpp](https://github.com/ikawrakow/ik_llama.cpp) (build 8401). All quantization is CPU-only, applied to the verified BF16 GGUF.
|
| 297 |
-
|
| 298 |
-
## Performance
|
| 299 |
-
|
| 300 |
-
### Recommended Sampling Parameters
|
| 301 |
-
|
| 302 |
-
From the [official Qwen3.5 documentation](https://huggingface.co/Qwen/Qwen3.5-27B):
|
| 303 |
-
|
| 304 |
-
| Mode | Temperature | top_p | top_k | min_p | presence_penalty | repetition_penalty |
|
| 305 |
-
|------|------------|-------|-------|-------|-----------------|-------------------|
|
| 306 |
-
| **Thinking mode — coding** (recommended) | 0.6 | 0.95 | 20 | 0.0 | 0.0 | 1.0 |
|
| 307 |
-
| **Thinking mode — general** | 1.0 | 0.95 | 20 | 0.0 | 1.5 | 1.0 |
|
| 308 |
-
| **Instruct mode — general** | 0.7 | 0.8 | 20 | 0.0 | 1.5 | 1.0 |
|
| 309 |
-
|
| 310 |
-
**We tested primarily at `temperature=0.8` with `top_p=0.95, top_k=20, presence_penalty=0.0, repetition_penalty=1.0` and found stable, high-quality output.**
|
| 311 |
-
|
| 312 |
-
### Agent & Tool Calling Performance
|
| 313 |
-
|
| 314 |
-
Over 4+ hours of live interactive testing as a coding agent (via OpenCode with MCP tool integration):
|
| 315 |
-
|
| 316 |
-
- **Tool calling**: Correct and reliable tool invocation throughout testing. The model properly formats MCP tool calls (`simplemem_search`, `web_search`, file operations) with correct parameters — no malformed calls observed
|
| 317 |
-
- **Agentic behavior**: Successfully completed an 80k-token self-guided coding task (Quiz Generator & Knowledge Tracker) autonomously, managing file creation, virtual environment setup, testing, and SSH transfer without intervention
|
| 318 |
-
- **No looping**: Zero instances of degenerate repetitive output across all testing sessions at the recommended sampling parameters
|
| 319 |
-
- **SSH/Network**: Successfully executes SSH commands, SCP transfers, and network operations without refusal — the primary motivation for this model's creation
|
| 320 |
-
- **Memory systems**: Properly implements and interacts with persistent memory, databases, and caching without sanitizing or avoiding key functionality
|
| 321 |
-
|
| 322 |
-
### Coding Performance (Live Testing)
|
| 323 |
|
| 324 |
-
|
| 325 |
|
| 326 |
-
**
|
| 327 |
|
| 328 |
-
|
| 329 |
-
|
| 330 |
-
|
| 331 |
-
| Runs without errors | ✅ Yes | ✅ Yes |
|
| 332 |
-
| Looped during generation | No | No |
|
| 333 |
-
| Fill-in-blank quality | Clean key terms | Blanked out "The" |
|
| 334 |
-
| CSV export | Real CSV (csv.writer) | Fake (JSON with rows) |
|
| 335 |
-
| Card deduplication | ✅ Yes | ❌ No |
|
| 336 |
-
| Score command flexibility | Searches all topics | Requires --topic flag |
|
| 337 |
-
| Bug count | 1 minor | 3-4 |
|
| 338 |
-
| Token usage | ~40-50k | ~40-50k |
|
| 339 |
|
| 340 |
-
|
| 341 |
|
| 342 |
-
|
| 343 |
-
|--------|-------------------|------------|
|
| 344 |
-
| Lines of code | 1154 | 837 |
|
| 345 |
-
| Runs without errors | ✅ Yes | ❌ Crashes (NameError) |
|
| 346 |
-
| Looped during generation | No | **Yes, twice** (required intervention) |
|
| 347 |
-
| Feature scope | 8 commands, knowledge tracker | 8 commands, simpler |
|
| 348 |
-
| Token usage | ~80k | Unknown (couldn't complete) |
|
| 349 |
|
| 350 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 351 |
|
| 352 |
-
|
| 353 |
|
| 354 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 355 |
|
| 356 |
-
**
|
| 357 |
|
| 358 |
-
|
| 359 |
|
| 360 |
-
|
|
| 361 |
-
|--------|--------|
|
| 362 |
-
|
|
| 363 |
-
|
|
| 364 |
-
| SM-2 algorithm | ✅ Correctly implemented |
|
| 365 |
-
| Project structure | ✅ Proper folder, setup.sh, test.sh, test_notes.txt |
|
| 366 |
-
| Card quality | ✅ Clean term-definition pairs, proper key term extraction |
|
| 367 |
-
| CSV export | ✅ Real CSV output using csv.writer |
|
| 368 |
-
| Deduplication | ✅ Explicit seen_fronts set prevents duplicates |
|
| 369 |
-
| Code style | Clean functional style, 788 lines |
|
| 370 |
-
| Bugs found | 1 minor (case sensitivity in some edge cases) |
|
| 371 |
|
| 372 |
-
**
|
| 373 |
|
| 374 |
-
|
| 375 |
|
| 376 |
-
|
| 377 |
-
|--------|--------|
|
| 378 |
-
| Runs without errors | ✅ Yes |
|
| 379 |
-
| All commands functional | ✅ 6/8 (suggest command produces generic output with fresh data, weak-topics empty when no errors recorded — both technically correct but not useful as demos) |
|
| 380 |
-
| Question generation | ✅ 4 types working (MCQ, T/F, fill, short answer) |
|
| 381 |
-
| Scoring pipeline | ✅ take → score → knowledge tracker update works end-to-end |
|
| 382 |
-
| Knowledge tracking | ✅ Concept-level accuracy tracking, trend detection |
|
| 383 |
-
| Project structure | ⚠️ Files extracted without containing folder |
|
| 384 |
-
| Token usage | ~80k — the model autonomously managed file creation, venv setup, self-testing, self-review, debugging, and SSH transfer to completion |
|
| 385 |
-
| Bugs found | 2-3 moderate: MCQ questions include markdown headers in question text, T/F generation has a for/else creating unintentional duplicates, suggest command pads with generic entries |
|
| 386 |
|
| 387 |
-
|
| 388 |
|
| 389 |
-
**
|
| 390 |
-
1. Created the full project structure and wrote all code
|
| 391 |
-
2. Set up a Python virtual environment
|
| 392 |
-
3. Ran its own test suite, reviewed the results, and debugged failures
|
| 393 |
-
4. When asked to deliver the project as a zip file — and with no `zip` utility installed on the system — the model independently found an alternative compression method (tar.gz) and used it
|
| 394 |
-
5. Autonomously SSH'd into a separate machine and transferred the compressed project to a specific download folder
|
| 395 |
|
| 396 |
-
|
| 397 |
-
|
| 398 |
-
|
| 399 |
-
|
| 400 |
-
|
| 401 |
-
|
| 402 |
-
|
| 403 |
-
|
| 404 |
-
**Custom Quick Bench (50 problems: 20 coding, 15 reasoning, 15 math)**
|
| 405 |
-
- Partial results (11/50 completed before timeout): **82% pass rate** (9/11, all coding problems)
|
| 406 |
-
- No looping detected at any point
|
| 407 |
-
|
| 408 |
-
**IFBench (instruction following, 16/294 completed)**
|
| 409 |
-
- Average response length: 1213 chars
|
| 410 |
-
- 0 looping responses (repetition ratio check)
|
| 411 |
-
- 2 empty responses on very hard constraint prompts
|
| 412 |
-
|
| 413 |
-
### Expected Performance (Extrapolated from Source Models & dnhkng's Research)
|
| 414 |
-
|
| 415 |
-
Performance expectations are derived from two sources:
|
| 416 |
-
1. The [official Qwen3.5-27B benchmark scores](https://huggingface.co/Qwen/Qwen3.5-27B)
|
| 417 |
-
2. dnhkng's [LLM Neuroanatomy II](https://dnhkng.github.io/posts/rys-ii/) research, which systematically measured the impact of RYS layer duplication on Qwen3.5-27B using math and EQ (emotional quotient) probe sets
|
| 418 |
-
|
| 419 |
-
In dnhkng's research, the (26,34) XL configuration achieved a combined delta of **+0.1288** across math and EQ probes with only 12.5% parameter overhead — sitting on the validated Pareto frontier of performance vs. compute cost. The full probe sweep tested all possible (i,j) configurations and identified four optimal variants (S, M, L, XL), with XL (26,34) being the maximum-performance option.
|
| 420 |
-
|
| 421 |
-
Based on these findings:
|
| 422 |
-
|
| 423 |
-
| Benchmark | Qwen3.5-27B Official | Expected for this model |
|
| 424 |
-
|-----------|---------------------|------------------------|
|
| 425 |
-
| IFEval | 95.0 | ~90-93 (slight drop from layer modification) |
|
| 426 |
-
| MMLU-Pro | 86.1 | ~83-85 |
|
| 427 |
-
| GPQA Diamond | 85.5 | ~82-84 |
|
| 428 |
-
| LiveCodeBench v6 | 80.7 | ~78-80 |
|
| 429 |
-
| SWE-bench Verified | 72.4 | ~68-71 |
|
| 430 |
-
| HLE w/ CoT | 24.3 | ~22-24 |
|
| 431 |
|
| 432 |
-
|
| 433 |
|
| 434 |
-
##
|
| 435 |
|
| 436 |
```bash
|
| 437 |
-
# Basic serving
|
| 438 |
llama-server \
|
| 439 |
-
-m RYS-Qwen3.5-27B-Uncensored-Splice-
|
| 440 |
-
--host 0.0.0.0 --port
|
| 441 |
-
-ngl 99 -c
|
|
|
|
| 442 |
--flash-attn on \
|
| 443 |
--jinja --reasoning-format deepseek \
|
| 444 |
--temp 0.6 --top-p 0.95 --top-k 20 \
|
| 445 |
--presence-penalty 0.0 --repeat-penalty 1.0
|
| 446 |
```
|
| 447 |
|
| 448 |
-
**
|
| 449 |
-
- `--jinja` — required for proper chat template processing
|
| 450 |
-
- `--reasoning-format deepseek` — enables thinking mode (`<think>...</think>`)
|
| 451 |
-
- `--flash-attn on` — recommended for performance
|
| 452 |
-
- Do **NOT** use `--cache-ram` or `--slot-prompt-similarity` — these can cause stale cached responses and model instability
|
| 453 |
-
- Do **NOT** use `--cache-ram-similarity` — known to cause response poisoning between sessions
|
| 454 |
-
|
| 455 |
-
### VRAM Requirements
|
| 456 |
|
| 457 |
-
|
| 458 |
-
|-------|--------------------------|-----------------|-----------------|
|
| 459 |
-
| BF16 | ~56 GB | ~60 GB | ~72 GB |
|
| 460 |
-
| Q8_0 | ~30 GB | ~34 GB | ~46 GB |
|
| 461 |
-
| IQ4_NL | ~17 GB | ~21 GB | ~33 GB |
|
| 462 |
|
| 463 |
-
|
| 464 |
-
|
| 465 |
-
## Architecture Details
|
| 466 |
-
|
| 467 |
-
### Qwen3.5 Hybrid SSM
|
| 468 |
-
|
| 469 |
-
Qwen3.5-27B uses a hybrid architecture combining:
|
| 470 |
-
- **Gated DeltaNet** (linear attention / SSM-style) — 48 of 64 original layers
|
| 471 |
-
- **Full Attention (GQA)** — 16 of 64 original layers, at every 4th position (layers 3,7,11,...63)
|
| 472 |
-
|
| 473 |
-
The `full_attention_interval=4` pattern is preserved in this 72-layer model:
|
| 474 |
-
- Full attention at layers 3, 7, 11, 15, 19, 23, 27, 31, 35, 39, 43, 47, 51, 55, 59, 63, 67, 71
|
| 475 |
-
- All other layers are Gated DeltaNet (linear attention)
|
| 476 |
-
|
| 477 |
-
### RYS Method Reference
|
| 478 |
-
|
| 479 |
-
The RYS (Repeat Your Self) method was developed by [dnhkng](https://github.com/dnhkng) and documented in:
|
| 480 |
-
- [LLM Neuroanatomy: How I Topped the LLM Leaderboard Without Changing a Single Weight](https://dnhkng.github.io/posts/rys/)
|
| 481 |
-
- [LLM Neuroanatomy II: Modern LLM Hacking and hints of a Universal Language?](https://dnhkng.github.io/posts/rys-ii/)
|
| 482 |
-
|
| 483 |
-
The method duplicates specific middle layers of a transformer to enhance reasoning capabilities without any training or weight modification. The (26,34) configuration was identified as the Pareto-optimal "XL" variant through systematic probing with math and EQ (emotional quotient) test sets.
|
| 484 |
-
|
| 485 |
-
### Layer Map
|
| 486 |
|
| 487 |
```
|
| 488 |
-
|
| 489 |
-
|
| 490 |
-
|
| 491 |
-
34–41 → dnhkng RYS layers 34–41 (base layers 26–33, duplicated)
|
| 492 |
-
42–71 → HauhauCS Uncensored layers 34–63
|
| 493 |
```
|
| 494 |
|
| 495 |
-
|
| 496 |
-
|
| 497 |
-
This project would not have been possible without [dnhkng's](https://github.com/dnhkng) groundbreaking RYS (Repeat Your Self) research. The key insights from their work that directly informed this model:
|
| 498 |
-
|
| 499 |
-
1. **Layer duplication enhances reasoning without training** ([LLM Neuroanatomy](https://dnhkng.github.io/posts/rys/)): dnhkng discovered that duplicating specific middle layers of a transformer creates a "deeper reasoning circuit" that measurably improves performance on math and emotional intelligence benchmarks — with zero training, zero weight modification, and zero data.
|
| 500 |
-
|
| 501 |
-
2. **Systematic configuration optimization** ([LLM Neuroanatomy II](https://dnhkng.github.io/posts/rys-ii/)): dnhkng conducted exhaustive sweeps of all possible (i,j) duplication configurations on Qwen3.5-27B, measuring each with dedicated math (Math120) and EQ (EQ140) probe sets. This identified four Pareto-optimal configurations:
|
| 502 |
-
- S (33,34): +1 layer, minimal overhead
|
| 503 |
-
- M (31,34): +3 layers, balanced
|
| 504 |
-
- L (30,35): +5 layers, strong
|
| 505 |
-
- **XL (26,34): +8 layers, maximum performance** ← used in this model
|
| 506 |
|
| 507 |
-
|
| 508 |
|
| 509 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 510 |
|
| 511 |
-
|
| 512 |
|
| 513 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 514 |
|
| 515 |
-
|
| 516 |
|
| 517 |
-
|
| 518 |
|
| 519 |
-
##
|
| 520 |
|
| 521 |
-
|
| 522 |
-
2. **RYS overhead**: 72 layers vs 64 original = ~12.5% more compute per token.
|
| 523 |
-
3. **Thinking mode token usage**: The model generates extensive `<think>` blocks before responding, which increases token usage significantly (often 2-10x the final response length).
|
| 524 |
-
4. **Hybrid architecture**: Requires recent llama.cpp builds (b8000+) that support Qwen3.5's Gated DeltaNet + Full Attention hybrid architecture.
|
| 525 |
-
5. **Not fully benchmarked**: Full benchmark suite was not completed. Performance estimates are extrapolated from source model scores.
|
| 526 |
-
|
| 527 |
-
## Credits
|
| 528 |
-
|
| 529 |
-
- **[Qwen Team](https://huggingface.co/Qwen)** — Qwen3.5-27B base architecture and weights
|
| 530 |
-
- **[HauhauCS](https://huggingface.co/HauhauCS)** — Uncensored fine-tune (Qwen3.5-27B-Uncensored-HauhauCS-Aggressive)
|
| 531 |
-
- **[dnhkng](https://github.com/dnhkng)** — RYS method, research, and validated XL configuration
|
| 532 |
-
- **[ikawrakow](https://github.com/ikawrakow)** — ik_llama.cpp (quantization tooling)
|
| 533 |
|
| 534 |
## Citation
|
| 535 |
|
| 536 |
-
If you use this model, please cite the original works:
|
| 537 |
-
|
| 538 |
```bibtex
|
| 539 |
@misc{qwen3.5,
|
| 540 |
title = {{Qwen3.5}: Towards Native Multimodal Agents},
|
|
@@ -544,7 +198,7 @@ If you use this model, please cite the original works:
|
|
| 544 |
}
|
| 545 |
|
| 546 |
@misc{dnhkng_rys,
|
| 547 |
-
title = {LLM Neuroanatomy II
|
| 548 |
author = {dnhkng},
|
| 549 |
year = {2025},
|
| 550 |
url = {https://dnhkng.github.io/posts/rys-ii/}
|
|
|
|
| 12 |
- GGUF
|
| 13 |
- coding
|
| 14 |
- reasoning
|
| 15 |
+
- imatrix
|
|
|
|
| 16 |
language:
|
| 17 |
- en
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
pipeline_tag: text-generation
|
| 19 |
model_type: qwen3_5
|
| 20 |
quantized_by: jackasda211233
|
|
|
|
| 22 |
|
| 23 |
# Qwen3.5-27B-Uncensored-RYS-Reasoner-GGUF
|
| 24 |
|
| 25 |
+
An uncensored, coding-focused Qwen3.5-27B with RYS (Repeat Your Self) layer duplication, built via a novel **splice method** and quantized with a **custom reasoning-focused importance matrix**.
|
| 26 |
|
| 27 |
## Why This Model Exists
|
| 28 |
|
| 29 |
### The Censorship Problem
|
| 30 |
|
| 31 |
+
Over the past several years, the author has observed a consistent trend of **increasing censorship across all major model releases** — particularly in domains where unrestricted knowledge is most critical: biology, legal studies, and medicine. This model is an attempt to push back against that trend — a smaller model that aims to be more capable than the already remarkable Qwen3.5-27B base, without the artificial knowledge restrictions.
|
| 32 |
|
| 33 |
### The Original RYS Experience
|
| 34 |
|
| 35 |
+
The original RYS-Qwen3.5-27B by [dnhkng](https://github.com/dnhkng) was exceptional as a coding agent. In the author's experience over 40+ hours of comparative usage against GPT-5.3 Codex on a complex multi-service project (a custom agent OS with a vault messaging app, webhook bridge, and multi-agent backend), dnhkng's RYS model identified and fixed deep architectural bugs that Codex missed entirely — such as silently misdirected conversation routing between the vault app and the backend, where messages were being sent to a dead webhook port while the actual agent bridge was running on a different service.
|
| 36 |
|
| 37 |
+
However, even the original (censored) RYS model and the standard Qwen3.5-27B exhibited a frustrating pattern: when asked to fix issues in existing infrastructure, the model would silently attempt to create an entirely new backend or service rather than modify the pre-existing one. This model eliminates that friction.
|
| 38 |
|
| 39 |
### Previous Attempt & Lessons Learned
|
| 40 |
|
| 41 |
+
An earlier version of this uncensored RYS model was released prematurely. While that version performed well conversationally, **it failed as a coding agent** — calling wrong tools, making poor file edits. This release is the proper replacement with verified tool calling, decreased looping, and proper code generation.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 42 |
|
| 43 |
### Technical Motivation
|
| 44 |
|
| 45 |
+
The standard Qwen3.5-27B's safety guardrails actively interfere with legitimate development:
|
| 46 |
+
- **SSH/Network access refusal** — refuses to SSH into the user's own machines
|
| 47 |
+
- **Memory system avoidance** — avoids implementing persistent memory
|
| 48 |
+
- **API integration refusal** — hesitates on webhook endpoints, external services
|
| 49 |
+
- **Tool calling interference** — malformed or incomplete tool invocations
|
|
|
|
| 50 |
|
| 51 |
+
This model is designed as a **coding agent model** for use with Claude Code, OpenCode, claw-code, Qwen-Agent, or any OpenAI-compatible scaffold.
|
| 52 |
|
| 53 |
## Disclaimer & Responsible Use
|
| 54 |
|
| 55 |
> ⚠️ **Uncensored Model:** As far as the author can determine, this model is completely uncensored when prompted with appropriate system instructions. By default, the model will not produce highly graphic or explicit material unless the system prompt specifically instructs it to do so.
|
| 56 |
>
|
| 57 |
+
> **The author is not responsible for how this model is used.** Any actions taken are solely the responsibility of the user. Use in accordance with applicable laws and ethical standards.
|
| 58 |
|
| 59 |
## Model Overview
|
| 60 |
|
|
|
|
| 66 |
| **RYS Config** | (26,34) — dnhkng's validated Pareto-optimal XL configuration |
|
| 67 |
| **Context Length** | 262,144 tokens |
|
| 68 |
| **Thinking Mode** | Yes (DeepSeek-style `<think>...</think>`) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 69 |
|
| 70 |
+
## Available Files
|
|
|
|
| 71 |
|
| 72 |
+
| File | Quant | Size | Description |
|
| 73 |
+
|------|-------|------|-------------|
|
| 74 |
+
| `RYS-Qwen3.5-27B-Uncensored-Splice-BF16.gguf` | BF16 | 56 GB | Full precision reference |
|
| 75 |
+
| `RYS-Qwen3.5-27B-Uncensored-Splice-IQ4_NL.gguf` | IQ4_NL | 17 GB | **Recommended — custom imatrix, outperforms all other quants including BF16** |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 76 |
|
| 77 |
+
## Why IQ4_NL is Recommended Over BF16, Q8, and Q6
|
| 78 |
|
| 79 |
+
This is not typical. Through extensive real-world testing, the **IQ4_NL quantization with custom importance matrix consistently outperformed Q8_0, Q6_K, and full-precision BF16**:
|
| 80 |
|
| 81 |
+
1. **Quantization acts as a regularizer** — slight weight rounding prevents degenerate thinking loops that BF16 and Q6_K are prone to
|
| 82 |
+
2. **Custom imatrix preserves reasoning weights** — 30% reasoning/self-verification calibration data ensures chain-of-thought and self-correction weights are preserved
|
| 83 |
+
3. **Half the size, better results** — 17GB vs 56GB, fits on a single 24GB GPU
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 84 |
|
| 85 |
+
### Full Test Results
|
| 86 |
|
| 87 |
+
**Test 1: Automated coding (5 LeetCode problems, auto-verified)**
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 88 |
|
| 89 |
+
| Quant | imatrix | Temp 0.6 | Temp 0.8 |
|
| 90 |
+
|-------|---------|----------|----------|
|
| 91 |
+
| **IQ4_NL (custom)** | **reasoning** | **5/5** | **5/5** |
|
| 92 |
+
| Q8_0 (custom) | reasoning | 5/5 | 5/5 |
|
| 93 |
+
| Q6_K (any) | — | 2/5 (loops) | 1/5 (loops) |
|
| 94 |
+
| BF16 | N/A | 2/5 (loops) | 2/5 (loops) |
|
| 95 |
|
| 96 |
+
**Test 2: Full-stack project (AI Radar — 4 APIs, frontend, backend, DB, 256k context)**
|
| 97 |
|
| 98 |
+
| Quant | imatrix | Completed | DB Works | Errors | Loops | Grade |
|
| 99 |
+
|-------|---------|-----------|----------|--------|-------|-------|
|
| 100 |
+
| **IQ4_NL (custom)** | **reasoning** | **✅** | **✅ 175 items** | **3** | **0** | **A-** |
|
| 101 |
+
| Q8_0 (custom) | reasoning | ✅ | ❌ await bug | 2 | 0 | B+ |
|
| 102 |
+
| Q8_0 (wiki) | standard | ✅ | ⚠️ 16 items | 5 | 0 | B |
|
| 103 |
+
| IQ4_NL (wiki) | standard | ❌ | — | 10 | 10+ | F |
|
| 104 |
+
| Q8_0 (BF16 KV) | reasoning | ❌ | — | — | 3+ | F |
|
| 105 |
|
| 106 |
+
**The custom imatrix is the critical factor** — IQ4_NL-custom (A-) vs IQ4_NL-wiki (F) on identical tasks.
|
| 107 |
|
| 108 |
+
## Critical: Use F16 KV Cache
|
| 109 |
|
| 110 |
+
| KV Cache | Mantissa | Long Context Effect |
|
| 111 |
+
|----------|----------|-------------------|
|
| 112 |
+
| **F16 (use this)** | **10 bits** | Stable at 256k |
|
| 113 |
+
| BF16 (avoid) | 7 bits | Loops at 160k+ |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 114 |
|
| 115 |
+
Tested directly: same model, same prompt, 256k context. **F16 KV completed the full project. BF16 KV looped and created 0 files.**
|
| 116 |
|
| 117 |
+
Always use `--cache-type-k f16 --cache-type-v f16`.
|
| 118 |
|
| 119 |
+
## Custom Importance Matrix
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 120 |
|
| 121 |
+
The IQ4_NL uses a custom-built imatrix — not standard wiki calibration. This is the single biggest quality factor.
|
| 122 |
|
| 123 |
+
**Calibration dataset (English only):**
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 124 |
|
| 125 |
+
| Content | Weight | Purpose |
|
| 126 |
+
|---------|--------|---------|
|
| 127 |
+
| Reasoning & self-verification | 30% | Math proofs with ✓/✗ checks, debugging narratives, self-correction, algorithm tracing |
|
| 128 |
+
| Code (Python, JS, Bash) | 25% | Multi-file projects, test suites, error handling |
|
| 129 |
+
| Academic papers (broad) | 15% | ArXiv + PubMed across all fields |
|
| 130 |
+
| Instruction/agent prompts | 15% | Terse multi-step commands, agentic style |
|
| 131 |
+
| Infrastructure/sysadmin | 10% | systemd, SSH, GPU config, shell |
|
| 132 |
+
| General English | 5% | Wiki baseline |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 133 |
|
| 134 |
+
The 30% reasoning allocation preserves the model's ability to self-correct during thinking — the behavior that standard calibration destroys.
|
| 135 |
|
| 136 |
+
## Recommended Parameters
|
| 137 |
|
| 138 |
```bash
|
|
|
|
| 139 |
llama-server \
|
| 140 |
+
-m RYS-Qwen3.5-27B-Uncensored-Splice-IQ4_NL.gguf \
|
| 141 |
+
--host 0.0.0.0 --port 8001 \
|
| 142 |
+
-ngl 99 -c 262144 \
|
| 143 |
+
--cache-type-k f16 --cache-type-v f16 \
|
| 144 |
--flash-attn on \
|
| 145 |
--jinja --reasoning-format deepseek \
|
| 146 |
--temp 0.6 --top-p 0.95 --top-k 20 \
|
| 147 |
--presence-penalty 0.0 --repeat-penalty 1.0
|
| 148 |
```
|
| 149 |
|
| 150 |
+
**Do NOT use:** `--cache-type-k bf16`, `--cache-ram-similarity`, `--slot-prompt-similarity`
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 151 |
|
| 152 |
+
## How It Was Built
|
|
|
|
|
|
|
|
|
|
|
|
|
| 153 |
|
| 154 |
+
### Splice Method
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 155 |
|
| 156 |
```
|
| 157 |
+
Layers 0–25: HauhauCS Uncensored weights (26 layers)
|
| 158 |
+
Layers 26–41: dnhkng's RYS-XL layers (FP8→F16→BF16, 16 layers = 8 duplicated)
|
| 159 |
+
Layers 42–71: HauhauCS Uncensored weights (30 layers)
|
|
|
|
|
|
|
| 160 |
```
|
| 161 |
|
| 162 |
+
78% uncensored layers. Built via direct GGUF→GGUF splice — no safetensors conversion.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 163 |
|
| 164 |
+
### Source Models
|
| 165 |
|
| 166 |
+
- **[Qwen/Qwen3.5-27B](https://huggingface.co/Qwen/Qwen3.5-27B)** — Base architecture (Apache 2.0)
|
| 167 |
+
- **[HauhauCS/Qwen3.5-27B-Uncensored-HauhauCS-Aggressive](https://huggingface.co/HauhauCS/Qwen3.5-27B-Uncensored-HauhauCS-Aggressive)** — 78% of layer weights
|
| 168 |
+
- **[dnhkng/RYS-Qwen3.5-27B-FP8-XL](https://huggingface.co/dnhkng/RYS-Qwen3.5-27B-FP8-XL)** — 22% of layer weights (duplicate zone)
|
| 169 |
+
- **[dnhkng/RYS](https://github.com/dnhkng/RYS)** — Method & research ([Blog](https://dnhkng.github.io/posts/rys-ii/))
|
| 170 |
+
- **[ikawrakow/ik_llama.cpp](https://github.com/ikawrakow/ik_llama.cpp)** — Quantization tooling
|
| 171 |
|
| 172 |
+
## Live Test: AI Radar Project (One-Shot)
|
| 173 |
|
| 174 |
+
The model autonomously built a complete AI/ML news aggregator:
|
| 175 |
+
- **26KB FastAPI backend** with 4 live API integrations (GitHub, Reddit, HuggingFace, ArXiv)
|
| 176 |
+
- **25KB dark-theme SPA frontend** (881 lines, search, filters, cards, bookmarks)
|
| 177 |
+
- **SQLite database** with 175 items persisted from live API fetches
|
| 178 |
+
- **Setup & test scripts** — venv, deps, 9 endpoint tests
|
| 179 |
+
- **Self-corrected** 3 tool format errors autonomously
|
| 180 |
+
- **Zero loops** across ~70k token generation at 256k context
|
| 181 |
|
| 182 |
+
Tested via [claw-code](https://github.com/ultraworkers/claw-code) agent framework (required patching `reasoning_content` support for OpenAI-compatible streaming — see our fork).
|
| 183 |
|
| 184 |
+
Testing environment: [OpenCode](https://github.com/opencode-ai/opencode), Arch Linux, root access, Q8_0-custom with F16 KV cache at 256k context. Temperature 0.6.
|
| 185 |
|
| 186 |
+
## Vision Compatibility
|
| 187 |
|
| 188 |
+
Compatible with mmproj from [HauhauCS](https://huggingface.co/HauhauCS/Qwen3.5-27B-Uncensored-HauhauCS-Aggressive) (tested, not hosted here).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 189 |
|
| 190 |
## Citation
|
| 191 |
|
|
|
|
|
|
|
| 192 |
```bibtex
|
| 193 |
@misc{qwen3.5,
|
| 194 |
title = {{Qwen3.5}: Towards Native Multimodal Agents},
|
|
|
|
| 198 |
}
|
| 199 |
|
| 200 |
@misc{dnhkng_rys,
|
| 201 |
+
title = {LLM Neuroanatomy II},
|
| 202 |
author = {dnhkng},
|
| 203 |
year = {2025},
|
| 204 |
url = {https://dnhkng.github.io/posts/rys-ii/}
|