Upload docs/features/rys_layer_duplication.md with huggingface_hub
Browse files
docs/features/rys_layer_duplication.md
CHANGED
|
@@ -150,6 +150,20 @@ dense arch first; **hard-error at load** if combined with DCA / rolling-KV /
|
|
| 150 |
sparse / MTP until each sizing loop is made eff-aware (explicit follow-ups). This
|
| 151 |
prevents silent under-allocation, which would corrupt rather than error.
|
| 152 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 153 |
## 7. Per-architecture scope
|
| 154 |
|
| 155 |
### Phase 1 — Qwen3.5 / Qwen3.6 **dense** (MVP target)
|
|
|
|
| 150 |
sparse / MTP until each sizing loop is made eff-aware (explicit follow-ups). This
|
| 151 |
prevents silent under-allocation, which would corrupt rather than error.
|
| 152 |
|
| 153 |
+
> **STATUS UPDATE (RYS-12 / #667, 2026-07-13 — SUPERSEDES the MVP rule above):**
|
| 154 |
+
> the DCA / rolling-KV-residency / sparse-attn guards are **LIFTED**. The three
|
| 155 |
+
> residency sizing loops (`opencoti_compute_auto_gpu_heads_frac` /
|
| 156 |
+
> `_resident_window_cells` / `_auto_select_kv_tier`) iterate the EFFECTIVE plan
|
| 157 |
+
> (eff→src), the DCA build path maps `eff→src` for `is_swa`, and sparse-attn
|
| 158 |
+
> alloc lives inside the eff-iteration loop (authoritative comment:
|
| 159 |
+
> `src/llama-context.cpp` ~line 268). RYS now composes with DCA, rolling-KV
|
| 160 |
+
> window/spill, sparse-attn, quant-KV, and MTP (draft context runs the plain
|
| 161 |
+
> base stack — bug-2171 — target keeps RYS; lossless). RYS × rolling-KV window
|
| 162 |
+
> spill was live-validated 2026-07-14 on the qwen35moe hybrid (bug-2172 gate:
|
| 163 |
+
> 44 eff layers + 256/40704 window+tail, needle recovered, no assert). The
|
| 164 |
+
> remaining hard-errors are: unsupported archs (RYS-4) and malformed/boundary
|
| 165 |
+
> plans (parse validation); boundary-band plans get an advisory WARN.
|
| 166 |
+
|
| 167 |
## 7. Per-architecture scope
|
| 168 |
|
| 169 |
### Phase 1 — Qwen3.5 / Qwen3.6 **dense** (MVP target)
|