---
license: apache-2.0
base_model: huihui-ai/Huihui-Qwen3.5-9B-abliterated
tags:
  - mnn
  - abliterated
  - uncensored
  - qwen3.5
  - on-device
  - mobile
  - roleplay
language:
  - en
library_name: mnn
---

## TokForge

- **Website:** https://tokforge.ai
- **Discord:** https://discord.gg/Acv3CBtfVm
- **Google Play:** https://play.google.com/store/apps/details?id=dev.tokforge
- **iOS TestFlight:** https://testflight.apple.com/join/jnufjzRr

Runs on-device in the TokForge app.

# Qwen3.5-9B Uncensored — MNN Format

**This is an MNN-converted version of [huihui-ai/Huihui-Qwen3.5-9B-abliterated](https://huggingface.co/huihui-ai/Huihui-Qwen3.5-9B-abliterated) for on-device mobile inference.**

All credit for the abliteration work goes to [huihui-ai](https://huggingface.co/huihui-ai). We only performed the MNN conversion and quantization for mobile deployment.

## What is this?

- **Base model:** [Qwen/Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B) by Alibaba
- **Abliteration by:** [huihui-ai](https://huggingface.co/huihui-ai) — removes refusal behavior via orthogonal projection (FailSpy technique)
- **MNN conversion by:** [darkmaniac7](https://huggingface.co/darkmaniac7) — 4-bit quantization (block size 128) for mobile GPU/CPU inference
- **Purpose:** On-device roleplay, creative fiction, and mature content without refusal. Richer writing and deeper character interactions than the 4B variant.

## Model Details

| Property | Value |
|----------|-------|
| Architecture | Qwen3.5 (LinearAttention) |
| Parameters | 9B |
| Quantization | 4-bit (block 128) |
| Format | MNN (Alibaba Mobile Neural Network) |
| Size on disk | ~5.0 GB |
| Backend | CPU (auto-routed — LinearAttention is faster on CPU than OpenCL) |
| Minimum RAM | 12 GB |

## Performance (measured on-device)

| Device | SoC | Backend | Decode tok/s |
|--------|-----|---------|-------------|
| RedMagic 11 Pro | SM8850 (SD 8 Elite 2) | CPU | 10.1 |
| Lenovo TB520FU | SM8650 (SD 8 Gen 3) | CPU | ~8.5 |

## Usage

This model is designed for [TokForge](https://tokforge.ai), an offline Android AI chat app. It can also be used with any MNN-compatible runtime.

### TokForge (Android)
Models → Recommended → Roleplay → "Qwen3.5 9B Uncensored" → Download

### Manual
Download all files and load with MNN's `llm_demo` or the MNN Transformer API.

## Limitations and Intended Use

- Intended for TokForge / MNN mobile inference and local roleplay-style use.
- `Qwen3.5` `LinearAttention` models route differently from standard Qwen3 targets and may prefer CPU on some phones.
- Large-model mobile performance depends heavily on device memory pressure and backend routing.
- This repo is a mobile runtime/export artifact, not a standard Transformers release.

## Files

| File | Size | Description |
|------|------|-------------|
| `llm.mnn` | 3.5 MB | Model graph |
| `llm.mnn.weight` | 4.2 GB | 4-bit quantized weights |
| `embeddings_bf16.bin` | 1.9 GB | Embedding weights (untied) |
| `llm_config.json` | 8 KB | Model configuration |
| `tokenizer.txt` | 6.1 MB | Tokenizer vocabulary |
| `config.json` | 342 B | HuggingFace config |

## Attribution

- **Original model:** [Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B) by Alibaba Cloud (Apache 2.0)
- **Abliteration:** [huihui-ai/Huihui-Qwen3.5-9B-abliterated](https://huggingface.co/huihui-ai/Huihui-Qwen3.5-9B-abliterated) by huihui-ai
- **MNN framework:** [Alibaba MNN](https://github.com/alibaba/MNN) (Apache 2.0)
- **MNN conversion:** darkmaniac7

## Community

- Website: [tokforge.ai](https://tokforge.ai)
- Discord: [Join the Discord](https://discord.gg/Acv3CBtfVm)

## License

Apache 2.0 (inherited from Qwen3.5)