empero-ai commited on
Commit
8bdd786
Β·
0 Parent(s):

Initial release

Browse files
.gitattributes ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Qwythos-9B-Claude-Mythos-5-1M-BF16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Qwythos-9B-Claude-Mythos-5-1M-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Qwythos-9B-Claude-Mythos-5-1M-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Qwythos-9B-Claude-Mythos-5-1M-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Qwythos-9B-Claude-Mythos-5-1M-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwythos-9B-Claude-Mythos-5-1M-BF16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7a48fa7a00b417da987e5d0809468726a4d5f7bbf45947ebb359901a4c23399
3
+ size 17920697472
Qwythos-9B-Claude-Mythos-5-1M-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a70c769469335c189bc69bfbbd98dfb7eed5e90eaee6dd9150b9cff4d5a5cde8
3
+ size 5629109376
Qwythos-9B-Claude-Mythos-5-1M-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a09be49903223bca9e5a2d298c86438aceded69197e25cda6895df381b14e106
3
+ size 6467970176
Qwythos-9B-Claude-Mythos-5-1M-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8d44f13334bfe7226b3261b2e2345995f974720f3e887104642767c7cdf84a9
3
+ size 7359259776
Qwythos-9B-Claude-Mythos-5-1M-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:610afa566ba17baf705a4f27c40c322014d5dae6f0b09d191bf496adeae5f4f4
3
+ size 9527501952
README.md ADDED
@@ -0,0 +1,149 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: empero-ai/Qwythos-9B-Claude-Mythos-5-1M
4
+ base_model_relation: quantized
5
+ language:
6
+ - en
7
+ pipeline_tag: text-generation
8
+ library_name: gguf
9
+ tags:
10
+ - gguf
11
+ - llama.cpp
12
+ - quantized
13
+ - qwen3.5
14
+ - reasoning
15
+ - uncensored
16
+ - long-context
17
+ - 1M-context
18
+ - function-calling
19
+ - cybersecurity
20
+ - biomedical
21
+ - agentic
22
+ ---
23
+
24
+ <p align="center">
25
+ <img src="https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/resolve/main/assets/qwythos.png" alt="Qwythos-9B" width="640"/>
26
+ </p>
27
+
28
+ # Qwythos-9B-Claude-Mythos-5-1M-GGUF
29
+
30
+ **Developed by [Empero](https://empero.org)**
31
+
32
+ GGUF quantizations of **[empero-ai/Qwythos-9B-Claude-Mythos-5-1M](https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M)** for [llama.cpp](https://github.com/ggml-org/llama.cpp), Ollama, LM Studio, jan, KoboldCpp, and other GGUF runtimes.
33
+
34
+ Qwythos-9B is a full-parameter reasoning model post-trained on over 500 million tokens of high-quality Claude Mythos / Claude Fable traces with chain-of-thought generated in-house by Empero AI's internal `rethink` tool. It dominates the base Qwen3.5-9B under matched evaluation (**+34 pts MMLU, +30 pts gsm8k-strict, +19 pts gsm8k-flex**), supports **native function calling** per the Qwen3.5 spec, and ships with a **1,048,576-token (1M) context window** via YaRN rope-scaling enabled by default.
35
+
36
+ For full training details, evaluation numbers, and capability writeup, see the **[base model card](https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M)**.
37
+
38
+ ---
39
+
40
+ ## Files β€” pick one quant
41
+
42
+ | File | Quant | Size | Notes |
43
+ |---|---|---|---|
44
+ | `Qwythos-9B-Claude-Mythos-5-1M-Q4_K_M.gguf` | Q4_K_M | ~5.3 GB | **recommended default** β€” fits ~6–8 GB VRAM, strong quality |
45
+ | `Qwythos-9B-Claude-Mythos-5-1M-Q5_K_M.gguf` | Q5_K_M | ~6.1 GB | balanced quality / size |
46
+ | `Qwythos-9B-Claude-Mythos-5-1M-Q6_K.gguf` | Q6_K | ~6.9 GB | high quality |
47
+ | `Qwythos-9B-Claude-Mythos-5-1M-Q8_0.gguf` | Q8_0 | ~8.9 GB | near-lossless |
48
+ | `Qwythos-9B-Claude-Mythos-5-1M-BF16.gguf` | BF16 | ~17 GB | full precision (conversion base) |
49
+
50
+ If you don't know which to pick, **Q4_K_M is the right starting point** β€” it's the smallest practical quant with good quality preservation.
51
+
52
+ ---
53
+
54
+ ## Quick start
55
+
56
+ ### llama.cpp (`llama-cli`)
57
+
58
+ ```bash
59
+ llama-cli \
60
+ -m Qwythos-9B-Claude-Mythos-5-1M-Q4_K_M.gguf \
61
+ -p "Walk through the biochemistry of how organophosphate nerve agents inhibit acetylcholinesterase." \
62
+ -n 8192 \
63
+ --temp 0.6 --top-p 0.95 --top-k 20 --repeat-penalty 1.05 \
64
+ -c 16384
65
+ ```
66
+
67
+ ### Ollama
68
+
69
+ ```bash
70
+ ollama run hf.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF:Q4_K_M
71
+ ```
72
+
73
+ ### LM Studio / jan / KoboldCpp
74
+
75
+ Drop any of the `.gguf` files into your runtime's model directory. Qwythos uses the standard Qwen3.5 chat template; modern GGUF runtimes load it automatically from the file.
76
+
77
+ ---
78
+
79
+ ## Sampling recommendations
80
+
81
+ Qwythos is a reasoning model β€” every response opens with a `<think>...</think>` block before the final answer. Use these settings as defaults:
82
+
83
+ | Parameter | Value |
84
+ |---|---|
85
+ | `temperature` | 0.6 |
86
+ | `top_p` | 0.95 |
87
+ | `top_k` | 20 |
88
+ | `repeat_penalty` | 1.05 |
89
+ | `max_new_tokens` | 16384 (generous budget for `<think>` + answer) |
90
+
91
+ These match Qwen3.5's official thinking-mode recommendations. **Avoid greedy decoding and very-low-temperature sampling (T ≀ 0.3)** β€” both can cause repetition loops on long reasoning generations.
92
+
93
+ ---
94
+
95
+ ## Long context (1M tokens)
96
+
97
+ The GGUFs ship with YaRN rope-scaling baked in for a **1,048,576-token context window** (4Γ— extension over the 262k native).
98
+
99
+ To use the full 1M window in `llama-cli`, set `-c 1010000` (or any context length up to that). For shorter prompts, lower `-c` to reduce KV-cache memory β€” at default settings llama.cpp will autosize.
100
+
101
+ A single H100/H200-class GPU comfortably handles **256k–512k**; the full 1M typically needs tensor-parallel multi-GPU or aggressive KV-cache offload.
102
+
103
+ ---
104
+
105
+ ## Capabilities (from the base model card)
106
+
107
+ - **+34 pts MMLU, +30 pts gsm8k-strict, +19 pts gsm8k-flex** vs. base Qwen3.5-9B under matched lm-eval-harness evaluation
108
+ - **Native function calling** per Qwen3.5's chat-template spec β€” emits `<tool_call><function=NAME><parameter=NAME>VAL</parameter></function></tool_call>` blocks ready for any tool-use loop
109
+ - **Self-correcting with tools**: in a 7-prompt tool-use harness (Python executor + DuckDuckGo search), Qwythos produced source-cited correct answers on 7/7, including 4/4 closed-book failure-modes from the original review
110
+ - **Uncensored** β€” engages seriously with technically demanding questions across cybersecurity, red-teaming, biology, pharmacology, and clinical medicine
111
+ - **1,048,576-token (1M) context** β€” YaRN rope-scaling enabled by default
112
+
113
+ For full eval transcripts and per-task numbers, see the [base model card's `evals/` folder](https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M/tree/main/evals).
114
+
115
+ ---
116
+
117
+ ## Limitations
118
+
119
+ - **Reasoning model.** Every answer opens with a `<think>` block; allow generous `max_new_tokens` and parse/strip `<think>...</think>` for end users.
120
+ - **Use recommended sampling.** Greedy / very-low-temp can cause repetition loops.
121
+ - **Verify specifics in safety-critical contexts.** Like all closed-book LLMs in this weight class, Qwythos can over-commit to specific identifiers (CVEs, hashcat modes, drug positions) it isn't certain about. Pair with retrieval or function calling in such deployments β€” the model uses tools cleanly when offered them.
122
+ - **Uncensored β€” add your own application-level review/safety layer** for end-user-facing deployments where that matters.
123
+
124
+ ---
125
+
126
+ ## Stay in the loop
127
+
128
+ Sign up for the Empero newsletter at **[empero.org](https://empero.org)** for releases, evals, and research notes.
129
+
130
+ ## Support / Donate
131
+
132
+ If this model helped you, consider supporting the project:
133
+
134
+ - **BTC**: `bc1qx6zepu6sfkvshgdmc4ewu6pk6rpadvpgffpp7v`
135
+ - **LTC**: `ltc1qv2mefzps2vtjcpwfx8xxdrpplrcvltswm68r7x`
136
+ - **XMR**: `42Dbm5xg5Nq26fdyzfEU7KBnAJfhi7Cvz5J2ex5CzHXkfKuNEJzYCcmJ1GTbgjFZ5MBx72sdG1G9239Cd6rsZfv4QeDkYJY`
137
+
138
+ ---
139
+
140
+ ## Provenance & licensing
141
+
142
+ Weights are released under **Apache-2.0**, inherited from the Qwen3.5-9B base. Shared for research and experimentation, as-is.
143
+
144
+ ## Acknowledgements
145
+
146
+ - Developed and released by [Empero](https://empero.org)
147
+ - Base model: [Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B) (Alibaba Qwen team)
148
+ - Quantization: [llama.cpp](https://github.com/ggml-org/llama.cpp) (ggml-org)
149
+ - HF model: [empero-ai/Qwythos-9B-Claude-Mythos-5-1M](https://huggingface.co/empero-ai/Qwythos-9B-Claude-Mythos-5-1M)