Instructions to use nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0
# Run inference directly in the terminal:
llama cli -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0
# Run inference directly in the terminal:
llama cli -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0

Use Docker

docker model run hf.co/nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0

LM Studio
Jan
Ollama
How to use nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding with Ollama:
```
ollama run hf.co/nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0
```

Unsloth Studio

How to use nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding to start chatting

How to use nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding with Docker Model Runner:
```
docker model run hf.co/nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0
```

Lemonade

How to use nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0

Run and chat with the model

lemonade run user.Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q8_0

List all available models

lemonade list

Hermes Agent

How to use nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "nerkyor/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding:Q8_0" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

nerkyor commited on Jul 8

Commit

2b21b18

verified ·

1 Parent(s): 8cb64ee

copy GGUF artifacts from standalone repo batch 3

Browse files

Files changed (41) hide show

.gitattributes +11 -0
GGUF/Q4_LynnStyle/eval/mtp/selected_eval_route.json +307 -0
GGUF/Q4_LynnStyle/eval/quality_mtp_smoke.summary.json +20 -0
GGUF/Q4_LynnStyle/lynnstyle/q4_tensor_type_match_report.md +531 -0
GGUF/Q4_LynnStyle/lynnstyle/q4_tensor_types.txt +7 -0
GGUF/Q4_LynnStyle/lynnstyle/quant_manifest.json +13 -0
GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00001-of-00004.gguf +3 -0
GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00002-of-00004.gguf +3 -0
GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00003-of-00004.gguf +3 -0
GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00004-of-00004.gguf +3 -0
GGUF/Q5_LynnStyle/Q5-imatrix-MTP-draft.gguf +3 -0
GGUF/Q5_LynnStyle/Q5-imatrix-MTP.manifest.json +51 -0
GGUF/Q5_LynnStyle/SHA256SUMS +6 -0
GGUF/Q5_LynnStyle/eval/coding100.summary.json +19 -0
GGUF/Q5_LynnStyle/eval/gpqa198.summary.json +18 -0
GGUF/Q5_LynnStyle/eval/lbc100.summary.json +35 -0
GGUF/Q5_LynnStyle/eval/mmlu500.summary.json +247 -0
GGUF/Q5_LynnStyle/eval/mtp/matrix.log +30 -0
GGUF/Q5_LynnStyle/eval/mtp/mtp_acceptance_matrix.json +1157 -0
GGUF/Q5_LynnStyle/eval/mtp/mtp_acceptance_matrix.md +19 -0
GGUF/Q5_LynnStyle/eval/mtp/mtp_settings.json +25 -0
GGUF/Q5_LynnStyle/eval/mtp/selected_eval_route.json +271 -0
GGUF/Q5_LynnStyle/eval/quality_mtp_smoke.summary.json +20 -0
GGUF/Q5_LynnStyle/lynnstyle/q5_tensor_type_match_report.md +531 -0
GGUF/Q5_LynnStyle/lynnstyle/q5_tensor_types.txt +7 -0
GGUF/Q5_LynnStyle/lynnstyle/quant_manifest.json +13 -0
GGUF/Q8_0/Q8-MTP-00001-of-00005.gguf +3 -0
GGUF/Q8_0/Q8-MTP-00002-of-00005.gguf +3 -0
GGUF/Q8_0/Q8-MTP-00003-of-00005.gguf +3 -0
GGUF/Q8_0/Q8-MTP-00004-of-00005.gguf +3 -0
GGUF/Q8_0/Q8-MTP-00005-of-00005.gguf +3 -0
GGUF/Q8_0/Q8-MTP-draft.gguf +3 -0
GGUF/Q8_0/Q8-MTP.manifest.json +13 -0
GGUF/Q8_0/SHA256SUMS +5 -0
GGUF/Q8_0/eval/coding100.summary.json +25 -0
GGUF/Q8_0/eval/gpqa198.summary.json +12 -0
GGUF/Q8_0/eval/lbc100.summary.json +22 -0
GGUF/Q8_0/eval/mmlu500.summary.json +12 -0
GGUF/Q8_0/eval/mtp/matrix.log +30 -0
GGUF/Q8_0/eval/mtp/mtp_acceptance_matrix.json +1157 -0
GGUF/Q8_0/eval/mtp/mtp_acceptance_matrix.md +19 -0

.gitattributes CHANGED Viewed

@@ -43,3 +43,14 @@ GGUF/Q4_LynnStyle/Q4-imatrix-MTP-00003-of-00004.gguf filter=lfs diff=lfs merge=l
 GGUF/Q4_LynnStyle/Q4-imatrix-MTP-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
 GGUF/Q4_LynnStyle/Q4-imatrix-MTP-draft-q4.gguf filter=lfs diff=lfs merge=lfs -text
 GGUF/Q4_LynnStyle/Q4-imatrix-MTP-draft.gguf filter=lfs diff=lfs merge=lfs -text

 GGUF/Q4_LynnStyle/Q4-imatrix-MTP-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
 GGUF/Q4_LynnStyle/Q4-imatrix-MTP-draft-q4.gguf filter=lfs diff=lfs merge=lfs -text
 GGUF/Q4_LynnStyle/Q4-imatrix-MTP-draft.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q5_LynnStyle/Q5-imatrix-MTP-draft.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q8_0/Q8-MTP-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q8_0/Q8-MTP-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q8_0/Q8-MTP-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q8_0/Q8-MTP-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q8_0/Q8-MTP-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
+GGUF/Q8_0/Q8-MTP-draft.gguf filter=lfs diff=lfs merge=lfs -text

GGUF/Q4_LynnStyle/eval/mtp/selected_eval_route.json ADDED Viewed

	@@ -0,0 +1,307 @@

+{
+  "chosen": {
+    "label": "c4_nomtp",
+    "c": 4,
+    "n": null,
+    "mtp": false,
+    "port": 19540,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 2155,
+    "wall_sec": 18.502,
+    "api_completion_tokens_per_sec": 116.471,
+    "server": {
+      "draft_acceptance_events": 0,
+      "draft_acceptance_weighted": null,
+      "draft_accepted_tokens": null,
+      "draft_generated_tokens": null,
+      "eval_tokens": 2416,
+      "eval_ms": 61442.77,
+      "eval_tokens_per_sec": 39.321,
+      "model_loaded": true,
+      "mtp_initialized": false
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.729,
+        "content_len": 57,
+        "reasoning_len": 135,
+        "completion_tokens": 118,
+        "total_tokens": 144,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 8.239,
+        "content_len": 82,
+        "reasoning_len": 378,
+        "completion_tokens": 272,
+        "total_tokens": 311,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.477,
+        "content_len": 43,
+        "reasoning_len": 285,
+        "completion_tokens": 176,
+        "total_tokens": 206,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.809,
+        "content_len": 654,
+        "reasoning_len": 286,
+        "completion_tokens": 380,
+        "total_tokens": 416,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.225,
+        "content_len": 252,
+        "reasoning_len": 679,
+        "completion_tokens": 384,
+        "total_tokens": 424,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 1.78,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.816,
+        "content_len": 327,
+        "reasoning_len": 608,
+        "completion_tokens": 382,
+        "total_tokens": 410,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.295,
+        "content_len": 318,
+        "reasoning_len": 418,
+        "completion_tokens": 384,
+        "total_tokens": 417,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/175_27b_q4_lynnstyle_v2calib_lbc30_gate_20260706/Q4_LYNN_DENSE_mtp_acceptance_matrix/c4_nomtp/server.log"
+  },
+  "fastest_mtp": {
+    "label": "c4_n3",
+    "c": 4,
+    "n": 3,
+    "mtp": true,
+    "port": 19543,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 2139,
+    "wall_sec": 25.803,
+    "api_completion_tokens_per_sec": 82.896,
+    "server": {
+      "draft_acceptance_events": 8,
+      "draft_acceptance_weighted": 0.887014,
+      "draft_accepted_tokens": 1209,
+      "draft_generated_tokens": 1363,
+      "eval_tokens": 2400,
+      "eval_ms": 87138.14,
+      "eval_tokens_per_sec": 27.542,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 6.519,
+        "content_len": 57,
+        "reasoning_len": 135,
+        "completion_tokens": 117,
+        "total_tokens": 143,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 13.969,
+        "content_len": 594,
+        "reasoning_len": 239,
+        "completion_tokens": 346,
+        "total_tokens": 382,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 13.973,
+        "content_len": 439,
+        "reasoning_len": 376,
+        "completion_tokens": 333,
+        "total_tokens": 373,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.831,
+        "content_len": 40,
+        "reasoning_len": 269,
+        "completion_tokens": 174,
+        "total_tokens": 204,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.717,
+        "content_len": 4,
+        "reasoning_len": 87,
+        "completion_tokens": 68,
+        "total_tokens": 97,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 19.355,
+        "content_len": 57,
+        "reasoning_len": 590,
+        "completion_tokens": 375,
+        "total_tokens": 414,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.605,
+        "content_len": 308,
+        "reasoning_len": 485,
+        "completion_tokens": 342,
+        "total_tokens": 370,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.828,
+        "content_len": 248,
+        "reasoning_len": 472,
+        "completion_tokens": 384,
+        "total_tokens": 417,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/175_27b_q4_lynnstyle_v2calib_lbc30_gate_20260706/Q4_LYNN_DENSE_mtp_acceptance_matrix/c4_n3/server.log"
+  },
+  "fastest_no_mtp": {
+    "label": "c4_nomtp",
+    "c": 4,
+    "n": null,
+    "mtp": false,
+    "port": 19540,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 2155,
+    "wall_sec": 18.502,
+    "api_completion_tokens_per_sec": 116.471,
+    "server": {
+      "draft_acceptance_events": 0,
+      "draft_acceptance_weighted": null,
+      "draft_accepted_tokens": null,
+      "draft_generated_tokens": null,
+      "eval_tokens": 2416,
+      "eval_ms": 61442.77,
+      "eval_tokens_per_sec": 39.321,
+      "model_loaded": true,
+      "mtp_initialized": false
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.729,
+        "content_len": 57,
+        "reasoning_len": 135,
+        "completion_tokens": 118,
+        "total_tokens": 144,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 8.239,
+        "content_len": 82,
+        "reasoning_len": 378,
+        "completion_tokens": 272,
+        "total_tokens": 311,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.477,
+        "content_len": 43,
+        "reasoning_len": 285,
+        "completion_tokens": 176,
+        "total_tokens": 206,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.809,
+        "content_len": 654,
+        "reasoning_len": 286,
+        "completion_tokens": 380,
+        "total_tokens": 416,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.225,
+        "content_len": 252,
+        "reasoning_len": 679,
+        "completion_tokens": 384,
+        "total_tokens": 424,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 1.78,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.816,
+        "content_len": 327,
+        "reasoning_len": 608,
+        "completion_tokens": 382,
+        "total_tokens": 410,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.295,
+        "content_len": 318,
+        "reasoning_len": 418,
+        "completion_tokens": 384,
+        "total_tokens": 417,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/175_27b_q4_lynnstyle_v2calib_lbc30_gate_20260706/Q4_LYNN_DENSE_mtp_acceptance_matrix/c4_nomtp/server.log"
+  },
+  "stable_rows": 15,
+  "source": "/root/autodl-tmp/step37-27b-distill/runs/175_27b_q4_lynnstyle_v2calib_lbc30_gate_20260706/Q4_LYNN_DENSE_mtp_acceptance_matrix/mtp_acceptance_matrix.json"
+}

GGUF/Q4_LynnStyle/eval/quality_mtp_smoke.summary.json ADDED Viewed

	@@ -0,0 +1,20 @@

+{
+  "target": "Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q4_LYNN_DENSE",
+  "n": 3,
+  "ok": 3,
+  "all_ok": true,
+  "hf_mtp_sidecar_exists": false,
+  "hf_mtp_sidecar_bytes": null,
+  "gguf_mtp_server": {
+    "mtp_requested": true,
+    "mtp_enabled": false,
+    "spec_type": "draft-mtp",
+    "n_max": 1,
+    "p_min": 0.6,
+    "draft_model": null,
+    "draft_model_bytes": null
+  },
+  "split_mtp_draft_gguf_exists": false,
+  "split_mtp_draft_gguf_bytes": null,
+  "generated_at": "2026-07-06T18:45:32+0800"
+}

GGUF/Q4_LynnStyle/lynnstyle/q4_tensor_type_match_report.md ADDED Viewed

	@@ -0,0 +1,531 @@

+# 27B Dense tensor-type match report
+tier: q4
+config: models/Qwen3.6-27B-DSV4Pro-GLM-55XH-Coding-SFT-RL-Final55True-v3-merged-bf16/config.json
+gguf: quantized/Qwen3.6-27B-DSV4Pro-GLM-55XH-Coding-SFT-RL-Final55True-v3/Q8_0/Qwen3.6-27B-DSV4Pro-GLM-55XH-Coding-SFT-RL-Final55True-v3-Q8_0.gguf
+num_tensor_names_seen: 755
+## early layers q8_0 hard protect
+rule: `^blk\.(0|1|2|3)\..*\.weight=q8_0`
+matches: 47
+- blk.0.attn_gate.weight
+- blk.0.attn_norm.weight
+- blk.0.attn_qkv.weight
+- blk.0.ffn_down.weight
+- blk.0.ffn_gate.weight
+- blk.0.ffn_up.weight
+- blk.0.post_attention_norm.weight
+- blk.0.ssm_alpha.weight
+- blk.0.ssm_beta.weight
+- blk.0.ssm_conv1d.weight
+- blk.0.ssm_norm.weight
+- blk.0.ssm_out.weight
+- blk.1.attn_gate.weight
+- blk.1.attn_norm.weight
+- blk.1.attn_qkv.weight
+- blk.1.ffn_down.weight
+- blk.1.ffn_gate.weight
+- blk.1.ffn_up.weight
+- blk.1.post_attention_norm.weight
+- blk.1.ssm_alpha.weight
+- blk.1.ssm_beta.weight
+- blk.1.ssm_conv1d.weight
+- blk.1.ssm_norm.weight
+- blk.1.ssm_out.weight
+- blk.2.attn_gate.weight
+- blk.2.attn_norm.weight
+- blk.2.attn_qkv.weight
+- blk.2.ffn_down.weight
+- blk.2.ffn_gate.weight
+- blk.2.ffn_up.weight
+- blk.2.post_attention_norm.weight
+- blk.2.ssm_alpha.weight
+- blk.2.ssm_beta.weight
+- blk.2.ssm_conv1d.weight
+- blk.2.ssm_norm.weight
+- blk.2.ssm_out.weight
+- blk.3.attn_k.weight
+- blk.3.attn_k_norm.weight
+- blk.3.attn_norm.weight
+- blk.3.attn_output.weight
+- blk.3.attn_q.weight
+- blk.3.attn_q_norm.weight
+- blk.3.attn_v.weight
+- blk.3.ffn_down.weight
+- blk.3.ffn_gate.weight
+- blk.3.ffn_up.weight
+- blk.3.post_attention_norm.weight
+## last four layers q8_0 hard protect
+rule: `^blk\.(60|61|62|63)\..*\.weight=q8_0`
+matches: 47
+- blk.60.attn_gate.weight
+- blk.60.attn_norm.weight
+- blk.60.attn_qkv.weight
+- blk.60.ffn_down.weight
+- blk.60.ffn_gate.weight
+- blk.60.ffn_up.weight
+- blk.60.post_attention_norm.weight
+- blk.60.ssm_alpha.weight
+- blk.60.ssm_beta.weight
+- blk.60.ssm_conv1d.weight
+- blk.60.ssm_norm.weight
+- blk.60.ssm_out.weight
+- blk.61.attn_gate.weight
+- blk.61.attn_norm.weight
+- blk.61.attn_qkv.weight
+- blk.61.ffn_down.weight
+- blk.61.ffn_gate.weight
+- blk.61.ffn_up.weight
+- blk.61.post_attention_norm.weight
+- blk.61.ssm_alpha.weight
+- blk.61.ssm_beta.weight
+- blk.61.ssm_conv1d.weight
+- blk.61.ssm_norm.weight
+- blk.61.ssm_out.weight
+- blk.62.attn_gate.weight
+- blk.62.attn_norm.weight
+- blk.62.attn_qkv.weight
+- blk.62.ffn_down.weight
+- blk.62.ffn_gate.weight
+- blk.62.ffn_up.weight
+- blk.62.post_attention_norm.weight
+- blk.62.ssm_alpha.weight
+- blk.62.ssm_beta.weight
+- blk.62.ssm_conv1d.weight
+- blk.62.ssm_norm.weight
+- blk.62.ssm_out.weight
+- blk.63.attn_k.weight
+- blk.63.attn_k_norm.weight
+- blk.63.attn_norm.weight
+- blk.63.attn_output.weight
+- blk.63.attn_q.weight
+- blk.63.attn_q_norm.weight
+- blk.63.attn_v.weight
+- blk.63.ffn_down.weight
+- blk.63.ffn_gate.weight
+- blk.63.ffn_up.weight
+- blk.63.post_attention_norm.weight
+## late shoulder layers q6_k protect
+rule: `^blk\.(56|57|58|59)\..*\.weight=q6_k`
+matches: 47
+- blk.56.attn_gate.weight
+- blk.56.attn_norm.weight
+- blk.56.attn_qkv.weight
+- blk.56.ffn_down.weight
+- blk.56.ffn_gate.weight
+- blk.56.ffn_up.weight
+- blk.56.post_attention_norm.weight
+- blk.56.ssm_alpha.weight
+- blk.56.ssm_beta.weight
+- blk.56.ssm_conv1d.weight
+- blk.56.ssm_norm.weight
+- blk.56.ssm_out.weight
+- blk.57.attn_gate.weight
+- blk.57.attn_norm.weight
+- blk.57.attn_qkv.weight
+- blk.57.ffn_down.weight
+- blk.57.ffn_gate.weight
+- blk.57.ffn_up.weight
+- blk.57.post_attention_norm.weight
+- blk.57.ssm_alpha.weight
+- blk.57.ssm_beta.weight
+- blk.57.ssm_conv1d.weight
+- blk.57.ssm_norm.weight
+- blk.57.ssm_out.weight
+- blk.58.attn_gate.weight
+- blk.58.attn_norm.weight
+- blk.58.attn_qkv.weight
+- blk.58.ffn_down.weight
+- blk.58.ffn_gate.weight
+- blk.58.ffn_up.weight
+- blk.58.post_attention_norm.weight
+- blk.58.ssm_alpha.weight
+- blk.58.ssm_beta.weight
+- blk.58.ssm_conv1d.weight
+- blk.58.ssm_norm.weight
+- blk.58.ssm_out.weight
+- blk.59.attn_k.weight
+- blk.59.attn_k_norm.weight
+- blk.59.attn_norm.weight
+- blk.59.attn_output.weight
+- blk.59.attn_q.weight
+- blk.59.attn_q_norm.weight
+- blk.59.attn_v.weight
+- blk.59.ffn_down.weight
+- blk.59.ffn_gate.weight
+- blk.59.ffn_up.weight
+- blk.59.post_attention_norm.weight
+## middle full-attention projections q5_k protect
+rule: `^blk\.(7|11|15|19|23|27|31|35|39|43|47|51|55)\.(attn_q|attn_k|attn_v|attn_output)\.weight=q5_k`
+matches: 52
+- blk.11.attn_k.weight
+- blk.11.attn_output.weight
+- blk.11.attn_q.weight
+- blk.11.attn_v.weight
+- blk.15.attn_k.weight
+- blk.15.attn_output.weight
+- blk.15.attn_q.weight
+- blk.15.attn_v.weight
+- blk.19.attn_k.weight
+- blk.19.attn_output.weight
+- blk.19.attn_q.weight
+- blk.19.attn_v.weight
+- blk.23.attn_k.weight
+- blk.23.attn_output.weight
+- blk.23.attn_q.weight
+- blk.23.attn_v.weight
+- blk.27.attn_k.weight
+- blk.27.attn_output.weight
+- blk.27.attn_q.weight
+- blk.27.attn_v.weight
+- blk.31.attn_k.weight
+- blk.31.attn_output.weight
+- blk.31.attn_q.weight
+- blk.31.attn_v.weight
+- blk.35.attn_k.weight
+- blk.35.attn_output.weight
+- blk.35.attn_q.weight
+- blk.35.attn_v.weight
+- blk.39.attn_k.weight
+- blk.39.attn_output.weight
+- blk.39.attn_q.weight
+- blk.39.attn_v.weight
+- blk.43.attn_k.weight
+- blk.43.attn_output.weight
+- blk.43.attn_q.weight
+- blk.43.attn_v.weight
+- blk.47.attn_k.weight
+- blk.47.attn_output.weight
+- blk.47.attn_q.weight
+- blk.47.attn_v.weight
+- blk.51.attn_k.weight
+- blk.51.attn_output.weight
+- blk.51.attn_q.weight
+- blk.51.attn_v.weight
+- blk.55.attn_k.weight
+- blk.55.attn_output.weight
+- blk.55.attn_q.weight
+- blk.55.attn_v.weight
+- blk.7.attn_k.weight
+- blk.7.attn_output.weight
+- blk.7.attn_q.weight
+- blk.7.attn_v.weight
+## middle linear-attention gates q5_k protect
+rule: `^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.attn_gate\.weight=q5_k`
+matches: 39
+- blk.10.attn_gate.weight
+- blk.12.attn_gate.weight
+- blk.13.attn_gate.weight
+- blk.14.attn_gate.weight
+- blk.16.attn_gate.weight
+- blk.17.attn_gate.weight
+- blk.18.attn_gate.weight
+- blk.20.attn_gate.weight
+- blk.21.attn_gate.weight
+- blk.22.attn_gate.weight
+- blk.24.attn_gate.weight
+- blk.25.attn_gate.weight
+- blk.26.attn_gate.weight
+- blk.28.attn_gate.weight
+- blk.29.attn_gate.weight
+- blk.30.attn_gate.weight
+- blk.32.attn_gate.weight
+- blk.33.attn_gate.weight
+- blk.34.attn_gate.weight
+- blk.36.attn_gate.weight
+- blk.37.attn_gate.weight
+- blk.38.attn_gate.weight
+- blk.4.attn_gate.weight
+- blk.40.attn_gate.weight
+- blk.41.attn_gate.weight
+- blk.42.attn_gate.weight
+- blk.44.attn_gate.weight
+- blk.45.attn_gate.weight
+- blk.46.attn_gate.weight
+- blk.48.attn_gate.weight
+- blk.49.attn_gate.weight
+- blk.5.attn_gate.weight
+- blk.50.attn_gate.weight
+- blk.52.attn_gate.weight
+- blk.53.attn_gate.weight
+- blk.54.attn_gate.weight
+- blk.6.attn_gate.weight
+- blk.8.attn_gate.weight
+- blk.9.attn_gate.weight
+## middle linear-attention qkv q5_k protect
+rule: `^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.attn_qkv\.weight=q5_k`
+matches: 39
+- blk.10.attn_qkv.weight
+- blk.12.attn_qkv.weight
+- blk.13.attn_qkv.weight
+- blk.14.attn_qkv.weight
+- blk.16.attn_qkv.weight
+- blk.17.attn_qkv.weight
+- blk.18.attn_qkv.weight
+- blk.20.attn_qkv.weight
+- blk.21.attn_qkv.weight
+- blk.22.attn_qkv.weight
+- blk.24.attn_qkv.weight
+- blk.25.attn_qkv.weight
+- blk.26.attn_qkv.weight
+- blk.28.attn_qkv.weight
+- blk.29.attn_qkv.weight
+- blk.30.attn_qkv.weight
+- blk.32.attn_qkv.weight
+- blk.33.attn_qkv.weight
+- blk.34.attn_qkv.weight
+- blk.36.attn_qkv.weight
+- blk.37.attn_qkv.weight
+- blk.38.attn_qkv.weight
+- blk.4.attn_qkv.weight
+- blk.40.attn_qkv.weight
+- blk.41.attn_qkv.weight
+- blk.42.attn_qkv.weight
+- blk.44.attn_qkv.weight
+- blk.45.attn_qkv.weight
+- blk.46.attn_qkv.weight
+- blk.48.attn_qkv.weight
+- blk.49.attn_qkv.weight
+- blk.5.attn_qkv.weight
+- blk.50.attn_qkv.weight
+- blk.52.attn_qkv.weight
+- blk.53.attn_qkv.weight
+- blk.54.attn_qkv.weight
+- blk.6.attn_qkv.weight
+- blk.8.attn_qkv.weight
+- blk.9.attn_qkv.weight
+## middle SSM tensor family q5_k protect
+rule: `^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.ssm_(alpha|beta|conv1d|norm|out)\.weight=q5_k`
+matches: 195
+- blk.10.ssm_alpha.weight
+- blk.10.ssm_beta.weight
+- blk.10.ssm_conv1d.weight
+- blk.10.ssm_norm.weight
+- blk.10.ssm_out.weight
+- blk.12.ssm_alpha.weight
+- blk.12.ssm_beta.weight
+- blk.12.ssm_conv1d.weight
+- blk.12.ssm_norm.weight
+- blk.12.ssm_out.weight
+- blk.13.ssm_alpha.weight
+- blk.13.ssm_beta.weight
+- blk.13.ssm_conv1d.weight
+- blk.13.ssm_norm.weight
+- blk.13.ssm_out.weight
+- blk.14.ssm_alpha.weight
+- blk.14.ssm_beta.weight
+- blk.14.ssm_conv1d.weight
+- blk.14.ssm_norm.weight
+- blk.14.ssm_out.weight
+- blk.16.ssm_alpha.weight
+- blk.16.ssm_beta.weight
+- blk.16.ssm_conv1d.weight
+- blk.16.ssm_norm.weight
+- blk.16.ssm_out.weight
+- blk.17.ssm_alpha.weight
+- blk.17.ssm_beta.weight
+- blk.17.ssm_conv1d.weight
+- blk.17.ssm_norm.weight
+- blk.17.ssm_out.weight
+- blk.18.ssm_alpha.weight
+- blk.18.ssm_beta.weight
+- blk.18.ssm_conv1d.weight
+- blk.18.ssm_norm.weight
+- blk.18.ssm_out.weight
+- blk.20.ssm_alpha.weight
+- blk.20.ssm_beta.weight
+- blk.20.ssm_conv1d.weight
+- blk.20.ssm_norm.weight
+- blk.20.ssm_out.weight
+- blk.21.ssm_alpha.weight
+- blk.21.ssm_beta.weight
+- blk.21.ssm_conv1d.weight
+- blk.21.ssm_norm.weight
+- blk.21.ssm_out.weight
+- blk.22.ssm_alpha.weight
+- blk.22.ssm_beta.weight
+- blk.22.ssm_conv1d.weight
+- blk.22.ssm_norm.weight
+- blk.22.ssm_out.weight
+- blk.24.ssm_alpha.weight
+- blk.24.ssm_beta.weight
+- blk.24.ssm_conv1d.weight
+- blk.24.ssm_norm.weight
+- blk.24.ssm_out.weight
+- blk.25.ssm_alpha.weight
+- blk.25.ssm_beta.weight
+- blk.25.ssm_conv1d.weight
+- blk.25.ssm_norm.weight
+- blk.25.ssm_out.weight
+- blk.26.ssm_alpha.weight
+- blk.26.ssm_beta.weight
+- blk.26.ssm_conv1d.weight
+- blk.26.ssm_norm.weight
+- blk.26.ssm_out.weight
+- blk.28.ssm_alpha.weight
+- blk.28.ssm_beta.weight
+- blk.28.ssm_conv1d.weight
+- blk.28.ssm_norm.weight
+- blk.28.ssm_out.weight
+- blk.29.ssm_alpha.weight
+- blk.29.ssm_beta.weight
+- blk.29.ssm_conv1d.weight
+- blk.29.ssm_norm.weight
+- blk.29.ssm_out.weight
+- blk.30.ssm_alpha.weight
+- blk.30.ssm_beta.weight
+- blk.30.ssm_conv1d.weight
+- blk.30.ssm_norm.weight
+- blk.30.ssm_out.weight
+- blk.32.ssm_alpha.weight
+- blk.32.ssm_beta.weight
+- blk.32.ssm_conv1d.weight
+- blk.32.ssm_norm.weight
+- blk.32.ssm_out.weight
+- blk.33.ssm_alpha.weight
+- blk.33.ssm_beta.weight
+- blk.33.ssm_conv1d.weight
+- blk.33.ssm_norm.weight
+- blk.33.ssm_out.weight
+- blk.34.ssm_alpha.weight
+- blk.34.ssm_beta.weight
+- blk.34.ssm_conv1d.weight
+- blk.34.ssm_norm.weight
+- blk.34.ssm_out.weight
+- blk.36.ssm_alpha.weight
+- blk.36.ssm_beta.weight
+- blk.36.ssm_conv1d.weight
+- blk.36.ssm_norm.weight
+- blk.36.ssm_out.weight
+- blk.37.ssm_alpha.weight
+- blk.37.ssm_beta.weight
+- blk.37.ssm_conv1d.weight
+- blk.37.ssm_norm.weight
+- blk.37.ssm_out.weight
+- blk.38.ssm_alpha.weight
+- blk.38.ssm_beta.weight
+- blk.38.ssm_conv1d.weight
+- blk.38.ssm_norm.weight
+- blk.38.ssm_out.weight
+- blk.4.ssm_alpha.weight
+- blk.4.ssm_beta.weight
+- blk.4.ssm_conv1d.weight
+- blk.4.ssm_norm.weight
+- blk.4.ssm_out.weight
+- blk.40.ssm_alpha.weight
+- blk.40.ssm_beta.weight
+- blk.40.ssm_conv1d.weight
+- blk.40.ssm_norm.weight
+- blk.40.ssm_out.weight
+- blk.41.ssm_alpha.weight
+- blk.41.ssm_beta.weight
+- blk.41.ssm_conv1d.weight
+- blk.41.ssm_norm.weight
+- blk.41.ssm_out.weight
+- blk.42.ssm_alpha.weight
+- blk.42.ssm_beta.weight
+- blk.42.ssm_conv1d.weight
+- blk.42.ssm_norm.weight
+- blk.42.ssm_out.weight
+- blk.44.ssm_alpha.weight
+- blk.44.ssm_beta.weight
+- blk.44.ssm_conv1d.weight
+- blk.44.ssm_norm.weight
+- blk.44.ssm_out.weight
+- blk.45.ssm_alpha.weight
+- blk.45.ssm_beta.weight
+- blk.45.ssm_conv1d.weight
+- blk.45.ssm_norm.weight
+- blk.45.ssm_out.weight
+- blk.46.ssm_alpha.weight
+- blk.46.ssm_beta.weight
+- blk.46.ssm_conv1d.weight
+- blk.46.ssm_norm.weight
+- blk.46.ssm_out.weight
+- blk.48.ssm_alpha.weight
+- blk.48.ssm_beta.weight
+- blk.48.ssm_conv1d.weight
+- blk.48.ssm_norm.weight
+- blk.48.ssm_out.weight
+- blk.49.ssm_alpha.weight
+- blk.49.ssm_beta.weight
+- blk.49.ssm_conv1d.weight
+- blk.49.ssm_norm.weight
+- blk.49.ssm_out.weight
+- blk.5.ssm_alpha.weight
+- blk.5.ssm_beta.weight
+- blk.5.ssm_conv1d.weight
+- blk.5.ssm_norm.weight
+- blk.5.ssm_out.weight
+- blk.50.ssm_alpha.weight
+- blk.50.ssm_beta.weight
+- blk.50.ssm_conv1d.weight
+- blk.50.ssm_norm.weight
+- blk.50.ssm_out.weight
+- blk.52.ssm_alpha.weight
+- blk.52.ssm_beta.weight
+- blk.52.ssm_conv1d.weight
+- blk.52.ssm_norm.weight
+- blk.52.ssm_out.weight
+- blk.53.ssm_alpha.weight
+- blk.53.ssm_beta.weight
+- blk.53.ssm_conv1d.weight
+- blk.53.ssm_norm.weight
+- blk.53.ssm_out.weight
+- blk.54.ssm_alpha.weight
+- blk.54.ssm_beta.weight
+- blk.54.ssm_conv1d.weight
+- blk.54.ssm_norm.weight
+- blk.54.ssm_out.weight
+- blk.6.ssm_alpha.weight
+- blk.6.ssm_beta.weight
+- blk.6.ssm_conv1d.weight
+- blk.6.ssm_norm.weight
+- blk.6.ssm_out.weight
+- blk.8.ssm_alpha.weight
+- blk.8.ssm_beta.weight
+- blk.8.ssm_conv1d.weight
+- blk.8.ssm_norm.weight
+- blk.8.ssm_out.weight
+- blk.9.ssm_alpha.weight
+- blk.9.ssm_beta.weight
+- blk.9.ssm_conv1d.weight
+- blk.9.ssm_norm.weight
+- blk.9.ssm_out.weight
+## Quantize command shape
+Use with final accepted BF16 GGUF, not an intermediate candidate:
+```bash
+llama-quantize --imatrix CALIB.imatrix --output-tensor-type q8_0 --token-embedding-type q8_0 --tensor-type-file runs/145_27b_gguf_lynnstyle_rules_20260705/q4_tensor_types.txt MODEL-F16.gguf MODEL-Q4_K_M-LynnDense.gguf q4_k_m THREADS
+```
+Run `--dry-run` first and archive the dry-run log.

GGUF/Q4_LynnStyle/lynnstyle/q4_tensor_types.txt ADDED Viewed

	@@ -0,0 +1,7 @@

+^blk\.(0|1|2|3)\..*\.weight=q8_0
+^blk\.(60|61|62|63)\..*\.weight=q8_0
+^blk\.(56|57|58|59)\..*\.weight=q6_k
+^blk\.(7|11|15|19|23|27|31|35|39|43|47|51|55)\.(attn_q|attn_k|attn_v|attn_output)\.weight=q5_k
+^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.attn_gate\.weight=q5_k
+^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.attn_qkv\.weight=q5_k
+^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.ssm_(alpha|beta|conv1d|norm|out)\.weight=q5_k

GGUF/Q4_LynnStyle/lynnstyle/quant_manifest.json ADDED Viewed

	@@ -0,0 +1,13 @@

+{
+  "tier": "q4",
+  "target": "Q4_LYNN_DENSE",
+  "base_qtype": "Q4_K_M",
+  "file": "/root/autodl-tmp/step37-27b-distill/quantized/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding/GGUF-LynnStyle-v2calib/Q4_LYNN_DENSE/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q4_LYNN_DENSE.gguf",
+  "bytes": 19575379360,
+  "sha256": "3a9af361e6891a78df61de134c91dfe27c27640839ac177b43c2a14fba77b189",
+  "tensor_type_file": "/root/autodl-tmp/step37-27b-distill/runs/175_27b_q4_lynnstyle_v2calib_lbc30_gate_20260706/q4_tensor_types.txt",
+  "tensor_match_report": "/root/autodl-tmp/step37-27b-distill/runs/175_27b_q4_lynnstyle_v2calib_lbc30_gate_20260706/q4_tensor_type_match_report.md",
+  "imatrix": "/root/autodl-tmp/step37-27b-distill/quantized/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding/GGUF-LynnStyle-v2calib/imatrix/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-lynnstyle-interleaved-20260706-ch512.imatrix.gguf",
+  "generated_at": "2026-07-06T18:39:07+0800",
+  "policy": "LynnStyle Dense protected GGUF: layer-position + tensor-family protection, not one-size quantization."
+}

GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00001-of-00004.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1d40f639d28ffdafaaaa2b64526aa3c3c8e2e8b24982ce57816bb464a1036574
+size 5368709120

GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00002-of-00004.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1717bd65c4bde45479b1a6bcbc21d791b1fdd5916ff888d8e8657a65ff9e5795
+size 5368709120

GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00003-of-00004.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a448daf3391b5a27bbd0bcbb829883e3ba0a19e47153a456f6b996911d424837
+size 5368709120

GGUF/Q5_LynnStyle/Q5-imatrix-MTP-00004-of-00004.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d73472f071db747f50e4f2fa29492baca7c6eeb1f0f5405ea7d23485ced5415c
+size 4962162080

GGUF/Q5_LynnStyle/Q5-imatrix-MTP-draft.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fb18a96292d43f746b39f2e3e8998e477788b5b7659d98a7cc192e9e753c8fd4
+size 3164005344

GGUF/Q5_LynnStyle/Q5-imatrix-MTP.manifest.json ADDED Viewed

	@@ -0,0 +1,51 @@

+{
+  "artifact": "Q5 LynnStyle Dense GGUF",
+  "model": "Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding",
+  "source_file": "/root/autodl-tmp/step37-27b-distill/quantized/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding/GGUF-LynnStyle-v2calib/Q5_LYNN_DENSE/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q5_LYNN_DENSE.gguf",
+  "source_bytes": 21068289440,
+  "source_sha256": "a2f790fc4352f1aa3b1df3eb3438a31f85ab2b37a039d69ffd3970e8abb6ab61",
+  "split_prefix": "Q5-imatrix-MTP",
+  "split_bytes": 5368709120,
+  "chunks": [
+    {
+      "name": "Q5-imatrix-MTP-00001-of-00004.gguf",
+      "bytes": 5368709120,
+      "sha256": "1d40f639d28ffdafaaaa2b64526aa3c3c8e2e8b24982ce57816bb464a1036574"
+    },
+    {
+      "name": "Q5-imatrix-MTP-00002-of-00004.gguf",
+      "bytes": 5368709120,
+      "sha256": "1717bd65c4bde45479b1a6bcbc21d791b1fdd5916ff888d8e8657a65ff9e5795"
+    },
+    {
+      "name": "Q5-imatrix-MTP-00003-of-00004.gguf",
+      "bytes": 5368709120,
+      "sha256": "a448daf3391b5a27bbd0bcbb829883e3ba0a19e47153a456f6b996911d424837"
+    },
+    {
+      "name": "Q5-imatrix-MTP-00004-of-00004.gguf",
+      "bytes": 4962162080,
+      "sha256": "d73472f071db747f50e4f2fa29492baca7c6eeb1f0f5405ea7d23485ced5415c"
+    }
+  ],
+  "mtp_draft": {
+    "name": "Q5-imatrix-MTP-draft.gguf",
+    "bytes": 3164005344,
+    "sha256": "fb18a96292d43f746b39f2e3e8998e477788b5b7659d98a7cc192e9e753c8fd4"
+  },
+  "quant_manifest": {
+    "tier": "q5",
+    "target": "Q5_LYNN_DENSE",
+    "base_qtype": "Q5_K_M",
+    "file": "/root/autodl-tmp/step37-27b-distill/quantized/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding/GGUF-LynnStyle-v2calib/Q5_LYNN_DENSE/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q5_LYNN_DENSE.gguf",
+    "bytes": 21068289440,
+    "sha256": "a2f790fc4352f1aa3b1df3eb3438a31f85ab2b37a039d69ffd3970e8abb6ab61",
+    "tensor_type_file": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/q5_tensor_types.txt",
+    "tensor_match_report": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/q5_tensor_type_match_report.md",
+    "imatrix": "/root/autodl-tmp/step37-27b-distill/quantized/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding/GGUF-LynnStyle-v2calib/imatrix/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-lynnstyle-interleaved-20260706-ch512.imatrix.gguf",
+    "generated_at": "2026-07-06T11:17:12+0800",
+    "policy": "LynnStyle Dense protected GGUF: layer-position + tensor-family protection, not one-size quantization."
+  },
+  "policy": "LynnStyle Dense explicit core-layer/tensor-family protection plus interleaved imatrix calibration.",
+  "generated_at": "2026-07-06T18:01:43+0800"
+}

GGUF/Q5_LynnStyle/SHA256SUMS ADDED Viewed

	@@ -0,0 +1,6 @@

+1d40f639d28ffdafaaaa2b64526aa3c3c8e2e8b24982ce57816bb464a1036574  Q5-imatrix-MTP-00001-of-00004.gguf
+1717bd65c4bde45479b1a6bcbc21d791b1fdd5916ff888d8e8657a65ff9e5795  Q5-imatrix-MTP-00002-of-00004.gguf
+a448daf3391b5a27bbd0bcbb829883e3ba0a19e47153a456f6b996911d424837  Q5-imatrix-MTP-00003-of-00004.gguf
+d73472f071db747f50e4f2fa29492baca7c6eeb1f0f5405ea7d23485ced5415c  Q5-imatrix-MTP-00004-of-00004.gguf
+fb18a96292d43f746b39f2e3e8998e477788b5b7659d98a7cc192e9e753c8fd4  Q5-imatrix-MTP-draft.gguf
+e0e7c8b4bd7204839c26dde708e5a7f8db5d28f49e7176a37e13a0fa4323b0e7  Q5-imatrix-MTP.manifest.json

GGUF/Q5_LynnStyle/eval/coding100.summary.json ADDED Viewed

	@@ -0,0 +1,19 @@

+{
+  "model": "Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q5_LYNN_DENSE",
+  "summary": {
+    "total": "57/100",
+    "byLang": {
+      "python": "0/10",
+      "javascript": "6/10",
+      "typescript": "8/10",
+      "rust": "8/10",
+      "go": "0/10",
+      "cpp": "7/10",
+      "sql": "0/10",
+      "bash": "8/10",
+      "css": "10/10",
+      "html": "10/10"
+    }
+  },
+  "n": 100
+}

GGUF/Q5_LynnStyle/eval/gpqa198.summary.json ADDED Viewed

	@@ -0,0 +1,18 @@

+{
+  "model": "step37-27b-q5-lynn",
+  "endpoint": "http://127.0.0.1:18181/v1",
+  "parser": "content_only_tail_explicit_v2",
+  "parser_note": "Answers are extracted from final content with tail/explicit-answer priority; reasoning_content is stored separately and never prepended to answer text.",
+  "n": 198,
+  "correct": 156,
+  "accuracy": 0.7878787878787878,
+  "elapsed_sec": 5650.033,
+  "qps": 0.035,
+  "parse_fail": 0,
+  "errors": 0,
+  "timeouts": 0,
+  "finish_reason_counts": {
+    "length": 29,
+    "stop": 169
+  }
+}

GGUF/Q5_LynnStyle/eval/lbc100.summary.json ADDED Viewed

	@@ -0,0 +1,35 @@

+{
+  "model": "Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q5_LYNN_DENSE",
+  "n": 100,
+  "passed": 75,
+  "accuracy": 0.75,
+  "notes": {
+    "wrong_answer_case": 16,
+    "runtime_error_case": 5,
+    "PASS": 75,
+    "error": 1,
+    "timeout_case": 3
+  },
+  "difficulty": {
+    "hard": "25/46",
+    "medium": "27/31",
+    "easy": "23/23"
+  },
+  "elapsed_sec": 2116.1875002384186,
+  "args": {
+    "data_dir": "/root/autodl-tmp/step37-27b-distill/eval-data/livecodebench_code_generation_lite_sample100",
+    "base_url": "http://127.0.0.1:18520/v1",
+    "model": "Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q5_LYNN_DENSE",
+    "out": "/root/autodl-tmp/step37-27b-distill/runs/154_27b_Q5_LYNN_DENSE_v2calib_full_eval_20260706/Q5_LYNN_DENSE/lbc100/lbc100.jsonl",
+    "sample": 100,
+    "seed": 20260519,
+    "concurrency": 4,
+    "timeout": 1200.0,
+    "max_tokens": 32768,
+    "temperature": 0.6,
+    "top_p": 0.95,
+    "case_timeout": 15.0,
+    "max_private_cases": 30,
+    "only_testtype": null
+  }
+}

GGUF/Q5_LynnStyle/eval/mmlu500.summary.json ADDED Viewed

	@@ -0,0 +1,247 @@

+{
+  "model": "step37-27b-q5-lynn",
+  "endpoint": "http://127.0.0.1:18181/v1",
+  "parser": "content_only_tail_explicit_v2",
+  "parser_note": "Answers are extracted from final content after stripping think spans, with tail/explicit-answer priority.",
+  "n": 500,
+  "subset": "all",
+  "shots": 5,
+  "correct": 461,
+  "accuracy": 0.922,
+  "elapsed_sec": 2056.523,
+  "qps": 0.2431,
+  "by_subject": {
+    "abstract_algebra": {
+      "acc": 1.0,
+      "n": 4
+    },
+    "anatomy": {
+      "acc": 1.0,
+      "n": 5
+    },
+    "astronomy": {
+      "acc": 1.0,
+      "n": 5
+    },
+    "business_ethics": {
+      "acc": 0.8,
+      "n": 5
+    },
+    "clinical_knowledge": {
+      "acc": 0.8889,
+      "n": 9
+    },
+    "college_biology": {
+      "acc": 1.0,
+      "n": 5
+    },
+    "college_chemistry": {
+      "acc": 1.0,
+      "n": 2
+    },
+    "college_computer_science": {
+      "acc": 1.0,
+      "n": 5
+    },
+    "college_mathematics": {
+      "acc": 1.0,
+      "n": 3
+    },
+    "college_medicine": {
+      "acc": 0.6667,
+      "n": 6
+    },
+    "computer_security": {
+      "acc": 1.0,
+      "n": 10
+    },
+    "conceptual_physics": {
+      "acc": 1.0,
+      "n": 6
+    },
+    "econometrics": {
+      "acc": 0.8571,
+      "n": 7
+    },
+    "electrical_engineering": {
+      "acc": 0.6667,
+      "n": 6
+    },
+    "elementary_mathematics": {
+      "acc": 1.0,
+      "n": 5
+    },
+    "formal_logic": {
+      "acc": 1.0,
+      "n": 4
+    },
+    "global_facts": {
+      "acc": 0.75,
+      "n": 8
+    },
+    "high_school_biology": {
+      "acc": 1.0,
+      "n": 9
+    },
+    "high_school_chemistry": {
+      "acc": 1.0,
+      "n": 7
+    },
+    "high_school_computer_science": {
+      "acc": 1.0,
+      "n": 2
+    },
+    "high_school_european_history": {
+      "acc": 0.7143,
+      "n": 7
+    },
+    "high_school_geography": {
+      "acc": 1.0,
+      "n": 6
+    },
+    "high_school_government_and_politics": {
+      "acc": 1.0,
+      "n": 8
+    },
+    "high_school_macroeconomics": {
+      "acc": 1.0,
+      "n": 11
+    },
+    "high_school_mathematics": {
+      "acc": 1.0,
+      "n": 13
+    },
+    "high_school_microeconomics": {
+      "acc": 1.0,
+      "n": 12
+    },
+    "high_school_physics": {
+      "acc": 1.0,
+      "n": 4
+    },
+    "high_school_psychology": {
+      "acc": 1.0,
+      "n": 18
+    },
+    "high_school_statistics": {
+      "acc": 0.9167,
+      "n": 12
+    },
+    "high_school_us_history": {
+      "acc": 1.0,
+      "n": 7
+    },
+    "high_school_world_history": {
+      "acc": 0.8889,
+      "n": 9
+    },
+    "human_aging": {
+      "acc": 0.8889,
+      "n": 9
+    },
+    "human_sexuality": {
+      "acc": 1.0,
+      "n": 3
+    },
+    "international_law": {
+      "acc": 1.0,
+      "n": 2
+    },
+    "jurisprudence": {
+      "acc": 1.0,
+      "n": 1
+    },
+    "logical_fallacies": {
+      "acc": 1.0,
+      "n": 2
+    },
+    "machine_learning": {
+      "acc": 1.0,
+      "n": 6
+    },
+    "management": {
+      "acc": 0.8333,
+      "n": 6
+    },
+    "marketing": {
+      "acc": 0.9167,
+      "n": 12
+    },
+    "medical_genetics": {
+      "acc": 1.0,
+      "n": 1
+    },
+    "miscellaneous": {
+      "acc": 1.0,
+      "n": 30
+    },
+    "moral_disputes": {
+      "acc": 1.0,
+      "n": 13
+    },
+    "moral_scenarios": {
+      "acc": 0.878,
+      "n": 41
+    },
+    "nutrition": {
+      "acc": 0.9091,
+      "n": 11
+    },
+    "philosophy": {
+      "acc": 0.9167,
+      "n": 12
+    },
+    "prehistory": {
+      "acc": 1.0,
+      "n": 10
+    },
+    "professional_accounting": {
+      "acc": 0.8889,
+      "n": 9
+    },
+    "professional_law": {
+      "acc": 0.8421,
+      "n": 57
+    },
+    "professional_medicine": {
+      "acc": 1.0,
+      "n": 11
+    },
+    "professional_psychology": {
+      "acc": 0.9333,
+      "n": 15
+    },
+    "public_relations": {
+      "acc": 0.5,
+      "n": 2
+    },
+    "security_studies": {
+      "acc": 0.9286,
+      "n": 14
+    },
+    "sociology": {
+      "acc": 1.0,
+      "n": 3
+    },
+    "us_foreign_policy": {
+      "acc": 1.0,
+      "n": 3
+    },
+    "virology": {
+      "acc": 0.3333,
+      "n": 3
+    },
+    "world_religions": {
+      "acc": 0.75,
+      "n": 4
+    }
+  },
+  "parse_fail": 0,
+  "errors": 0,
+  "finish": {
+    "stop": 500,
+    "length": 0,
+    "error": 0,
+    "other": 0
+  }
+}

GGUF/Q5_LynnStyle/eval/mtp/matrix.log ADDED Viewed

	@@ -0,0 +1,30 @@

+[matrix] start c1_nomtp port=19500
+[matrix] done c1_nomtp ok=4/4 nonempty_any=4 api_tps=54.553 accept=None
+[matrix] start c1_n1 port=19501
+[matrix] done c1_n1 ok=4/4 nonempty_any=4 api_tps=61.588 accept=0.931034
+[matrix] start c1_n2 port=19502
+[matrix] done c1_n2 ok=4/4 nonempty_any=4 api_tps=66.44 accept=0.928943
+[matrix] start c1_n3 port=19503
+[matrix] done c1_n3 ok=4/4 nonempty_any=4 api_tps=68.078 accept=0.895928
+[matrix] start c1_n4 port=19504
+[matrix] done c1_n4 ok=4/4 nonempty_any=4 api_tps=67.097 accept=0.860759
+[matrix] start c2_nomtp port=19505
+[matrix] done c2_nomtp ok=4/4 nonempty_any=4 api_tps=71.172 accept=None
+[matrix] start c2_n1 port=19506
+[matrix] done c2_n1 ok=4/4 nonempty_any=4 api_tps=65.157 accept=0.941634
+[matrix] start c2_n2 port=19507
+[matrix] done c2_n2 ok=4/4 nonempty_any=4 api_tps=73.264 accept=0.928687
+[matrix] start c2_n3 port=19508
+[matrix] done c2_n3 ok=4/4 nonempty_any=4 api_tps=69.29 accept=0.918033
+[matrix] start c2_n4 port=19509
+[matrix] done c2_n4 ok=4/4 nonempty_any=4 api_tps=76.176 accept=0.874525
+[matrix] start c4_nomtp port=19510
+[matrix] done c4_nomtp ok=8/8 nonempty_any=8 api_tps=100.98 accept=None
+[matrix] start c4_n1 port=19511
+[matrix] done c4_n1 ok=8/8 nonempty_any=8 api_tps=66.023 accept=0.931896
+[matrix] start c4_n2 port=19512
+[matrix] done c4_n2 ok=8/8 nonempty_any=8 api_tps=70.167 accept=0.905764
+[matrix] start c4_n3 port=19513
+[matrix] done c4_n3 ok=8/8 nonempty_any=8 api_tps=71.49 accept=0.896641
+[matrix] start c4_n4 port=19514
+[matrix] done c4_n4 ok=8/8 nonempty_any=8 api_tps=70.093 accept=0.86089

GGUF/Q5_LynnStyle/eval/mtp/mtp_acceptance_matrix.json ADDED Viewed

	@@ -0,0 +1,1157 @@

+[
+  {
+    "label": "c1_nomtp",
+    "c": 1,
+    "n": null,
+    "mtp": false,
+    "port": 19500,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1087,
+    "wall_sec": 19.925,
+    "api_completion_tokens_per_sec": 54.553,
+    "server": {
+      "draft_acceptance_events": 0,
+      "draft_acceptance_weighted": null,
+      "draft_accepted_tokens": null,
+      "draft_generated_tokens": null,
+      "eval_tokens": 1228,
+      "eval_ms": 19286.35,
+      "eval_tokens_per_sec": 63.672,
+      "model_loaded": true,
+      "mtp_initialized": false
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 2.373,
+        "content_len": 75,
+        "reasoning_len": 134,
+        "completion_tokens": 126,
+        "total_tokens": 152,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.342,
+        "content_len": 389,
+        "reasoning_len": 338,
+        "completion_tokens": 291,
+        "total_tokens": 331,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.287,
+        "content_len": 97,
+        "reasoning_len": 365,
+        "completion_tokens": 286,
+        "total_tokens": 325,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.918,
+        "content_len": 409,
+        "reasoning_len": 424,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c1_nomtp/server.log"
+  },
+  {
+    "label": "c1_n1",
+    "c": 1,
+    "n": 1,
+    "mtp": true,
+    "port": 19501,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 3,
+    "nonempty_any": 4,
+    "completion_tokens": 1214,
+    "wall_sec": 19.712,
+    "api_completion_tokens_per_sec": 61.588,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.931034,
+      "draft_accepted_tokens": 486,
+      "draft_generated_tokens": 522,
+      "eval_tokens": 1355,
+      "eval_ms": 18809.29,
+      "eval_tokens_per_sec": 72.039,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 2.129,
+        "content_len": 54,
+        "reasoning_len": 139,
+        "completion_tokens": 117,
+        "total_tokens": 143,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 4.939,
+        "content_len": 339,
+        "reasoning_len": 486,
+        "completion_tokens": 329,
+        "total_tokens": 369,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.481,
+        "content_len": 0,
+        "reasoning_len": 652,
+        "completion_tokens": 384,
+        "total_tokens": 423,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.163,
+        "content_len": 162,
+        "reasoning_len": 765,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c1_n1/server.log"
+  },
+  {
+    "label": "c1_n2",
+    "c": 1,
+    "n": 2,
+    "mtp": true,
+    "port": 19502,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1021,
+    "wall_sec": 15.367,
+    "api_completion_tokens_per_sec": 66.44,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.928943,
+      "draft_accepted_tokens": 536,
+      "draft_generated_tokens": 577,
+      "eval_tokens": 1162,
+      "eval_ms": 14783.29,
+      "eval_tokens_per_sec": 78.602,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 2.052,
+        "content_len": 73,
+        "reasoning_len": 136,
+        "completion_tokens": 126,
+        "total_tokens": 152,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 3.294,
+        "content_len": 154,
+        "reasoning_len": 393,
+        "completion_tokens": 222,
+        "total_tokens": 262,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 4.567,
+        "content_len": 65,
+        "reasoning_len": 423,
+        "completion_tokens": 289,
+        "total_tokens": 328,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.453,
+        "content_len": 129,
+        "reasoning_len": 761,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c1_n2/server.log"
+  },
+  {
+    "label": "c1_n3",
+    "c": 1,
+    "n": 3,
+    "mtp": true,
+    "port": 19503,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1025,
+    "wall_sec": 15.056,
+    "api_completion_tokens_per_sec": 68.078,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.895928,
+      "draft_accepted_tokens": 594,
+      "draft_generated_tokens": 663,
+      "eval_tokens": 1166,
+      "eval_ms": 14427.52,
+      "eval_tokens_per_sec": 80.818,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 2.078,
+        "content_len": 70,
+        "reasoning_len": 136,
+        "completion_tokens": 125,
+        "total_tokens": 151,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 3.798,
+        "content_len": 212,
+        "reasoning_len": 402,
+        "completion_tokens": 260,
+        "total_tokens": 300,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 3.99,
+        "content_len": 74,
+        "reasoning_len": 350,
+        "completion_tokens": 256,
+        "total_tokens": 295,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.19,
+        "content_len": 273,
+        "reasoning_len": 618,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c1_n3/server.log"
+  },
+  {
+    "label": "c1_n4",
+    "c": 1,
+    "n": 4,
+    "mtp": true,
+    "port": 19504,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1035,
+    "wall_sec": 15.425,
+    "api_completion_tokens_per_sec": 67.097,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.860759,
+      "draft_accepted_tokens": 612,
+      "draft_generated_tokens": 711,
+      "eval_tokens": 1176,
+      "eval_ms": 14805.52,
+      "eval_tokens_per_sec": 79.43,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 1.971,
+        "content_len": 54,
+        "reasoning_len": 136,
+        "completion_tokens": 115,
+        "total_tokens": 141,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 4.164,
+        "content_len": 374,
+        "reasoning_len": 351,
+        "completion_tokens": 297,
+        "total_tokens": 337,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 4.01,
+        "content_len": 80,
+        "reasoning_len": 328,
+        "completion_tokens": 239,
+        "total_tokens": 278,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.279,
+        "content_len": 150,
+        "reasoning_len": 759,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c1_n4/server.log"
+  },
+  {
+    "label": "c2_nomtp",
+    "c": 2,
+    "n": null,
+    "mtp": false,
+    "port": 19505,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 3,
+    "nonempty_any": 4,
+    "completion_tokens": 1036,
+    "wall_sec": 14.556,
+    "api_completion_tokens_per_sec": 71.172,
+    "server": {
+      "draft_acceptance_events": 0,
+      "draft_acceptance_weighted": null,
+      "draft_accepted_tokens": null,
+      "draft_generated_tokens": null,
+      "eval_tokens": 1177,
+      "eval_ms": 22504.86,
+      "eval_tokens_per_sec": 52.3,
+      "model_loaded": true,
+      "mtp_initialized": false
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 2.781,
+        "content_len": 54,
+        "reasoning_len": 136,
+        "completion_tokens": 115,
+        "total_tokens": 141,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.375,
+        "content_len": 437,
+        "reasoning_len": 344,
+        "completion_tokens": 311,
+        "total_tokens": 351,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.663,
+        "content_len": 79,
+        "reasoning_len": 302,
+        "completion_tokens": 226,
+        "total_tokens": 265,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.18,
+        "content_len": 0,
+        "reasoning_len": 903,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c2_nomtp/server.log"
+  },
+  {
+    "label": "c2_n1",
+    "c": 2,
+    "n": 1,
+    "mtp": true,
+    "port": 19506,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1198,
+    "wall_sec": 18.386,
+    "api_completion_tokens_per_sec": 65.157,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.941634,
+      "draft_accepted_tokens": 484,
+      "draft_generated_tokens": 514,
+      "eval_tokens": 1339,
+      "eval_ms": 33977.46,
+      "eval_tokens_per_sec": 39.408,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 4.076,
+        "content_len": 63,
+        "reasoning_len": 136,
+        "completion_tokens": 119,
+        "total_tokens": 145,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.487,
+        "content_len": 422,
+        "reasoning_len": 344,
+        "completion_tokens": 311,
+        "total_tokens": 351,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.073,
+        "content_len": 38,
+        "reasoning_len": 592,
+        "completion_tokens": 384,
+        "total_tokens": 423,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 8.898,
+        "content_len": 669,
+        "reasoning_len": 267,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c2_n1/server.log"
+  },
+  {
+    "label": "c2_n2",
+    "c": 2,
+    "n": 2,
+    "mtp": true,
+    "port": 19507,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1059,
+    "wall_sec": 14.454,
+    "api_completion_tokens_per_sec": 73.264,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.928687,
+      "draft_accepted_tokens": 573,
+      "draft_generated_tokens": 617,
+      "eval_tokens": 1200,
+      "eval_ms": 25540.23,
+      "eval_tokens_per_sec": 46.985,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.442,
+        "content_len": 54,
+        "reasoning_len": 135,
+        "completion_tokens": 115,
+        "total_tokens": 141,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.804,
+        "content_len": 388,
+        "reasoning_len": 344,
+        "completion_tokens": 294,
+        "total_tokens": 334,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 8.158,
+        "content_len": 64,
+        "reasoning_len": 371,
+        "completion_tokens": 266,
+        "total_tokens": 305,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.648,
+        "content_len": 449,
+        "reasoning_len": 463,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c2_n2/server.log"
+  },
+  {
+    "label": "c2_n3",
+    "c": 2,
+    "n": 3,
+    "mtp": true,
+    "port": 19508,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 988,
+    "wall_sec": 14.259,
+    "api_completion_tokens_per_sec": 69.29,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.918033,
+      "draft_accepted_tokens": 560,
+      "draft_generated_tokens": 610,
+      "eval_tokens": 1129,
+      "eval_ms": 24858.99,
+      "eval_tokens_per_sec": 45.416,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.706,
+        "content_len": 54,
+        "reasoning_len": 139,
+        "completion_tokens": 117,
+        "total_tokens": 143,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.915,
+        "content_len": 233,
+        "reasoning_len": 378,
+        "completion_tokens": 243,
+        "total_tokens": 283,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.711,
+        "content_len": 56,
+        "reasoning_len": 359,
+        "completion_tokens": 244,
+        "total_tokens": 283,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.342,
+        "content_len": 369,
+        "reasoning_len": 450,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c2_n3/server.log"
+  },
+  {
+    "label": "c2_n4",
+    "c": 2,
+    "n": 4,
+    "mtp": true,
+    "port": 19509,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1112,
+    "wall_sec": 14.598,
+    "api_completion_tokens_per_sec": 76.176,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.874525,
+      "draft_accepted_tokens": 690,
+      "draft_generated_tokens": 789,
+      "eval_tokens": 1253,
+      "eval_ms": 26235.45,
+      "eval_tokens_per_sec": 47.76,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.556,
+        "content_len": 69,
+        "reasoning_len": 136,
+        "completion_tokens": 122,
+        "total_tokens": 148,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.809,
+        "content_len": 425,
+        "reasoning_len": 406,
+        "completion_tokens": 322,
+        "total_tokens": 362,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 8.542,
+        "content_len": 82,
+        "reasoning_len": 389,
+        "completion_tokens": 284,
+        "total_tokens": 323,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.787,
+        "content_len": 400,
+        "reasoning_len": 438,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c2_n4/server.log"
+  },
+  {
+    "label": "c4_nomtp",
+    "c": 4,
+    "n": null,
+    "mtp": false,
+    "port": 19510,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 1957,
+    "wall_sec": 19.38,
+    "api_completion_tokens_per_sec": 100.98,
+    "server": {
+      "draft_acceptance_events": 0,
+      "draft_acceptance_weighted": null,
+      "draft_accepted_tokens": null,
+      "draft_generated_tokens": null,
+      "eval_tokens": 2218,
+      "eval_ms": 62981.58,
+      "eval_tokens_per_sec": 35.217,
+      "model_loaded": true,
+      "mtp_initialized": false
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 4.316,
+        "content_len": 68,
+        "reasoning_len": 136,
+        "completion_tokens": 123,
+        "total_tokens": 149,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.133,
+        "content_len": 61,
+        "reasoning_len": 282,
+        "completion_tokens": 203,
+        "total_tokens": 242,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.283,
+        "content_len": 217,
+        "reasoning_len": 440,
+        "completion_tokens": 262,
+        "total_tokens": 302,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.102,
+        "content_len": 42,
+        "reasoning_len": 248,
+        "completion_tokens": 158,
+        "total_tokens": 188,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.258,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 13.797,
+        "content_len": 260,
+        "reasoning_len": 691,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.238,
+        "content_len": 258,
+        "reasoning_len": 604,
+        "completion_tokens": 384,
+        "total_tokens": 412,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.095,
+        "content_len": 85,
+        "reasoning_len": 620,
+        "completion_tokens": 384,
+        "total_tokens": 417,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c4_nomtp/server.log"
+  },
+  {
+    "label": "c4_n1",
+    "c": 4,
+    "n": 1,
+    "mtp": true,
+    "port": 19511,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 2038,
+    "wall_sec": 30.868,
+    "api_completion_tokens_per_sec": 66.023,
+    "server": {
+      "draft_acceptance_events": 8,
+      "draft_acceptance_weighted": 0.931896,
+      "draft_accepted_tokens": 821,
+      "draft_generated_tokens": 881,
+      "eval_tokens": 2299,
+      "eval_ms": 104498.6,
+      "eval_tokens_per_sec": 22.0,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 7.361,
+        "content_len": 54,
+        "reasoning_len": 136,
+        "completion_tokens": 116,
+        "total_tokens": 142,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 17.071,
+        "content_len": 390,
+        "reasoning_len": 344,
+        "completion_tokens": 294,
+        "total_tokens": 334,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.12,
+        "content_len": 34,
+        "reasoning_len": 252,
+        "completion_tokens": 161,
+        "total_tokens": 191,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 20.098,
+        "content_len": 59,
+        "reasoning_len": 510,
+        "completion_tokens": 331,
+        "total_tokens": 370,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 22.403,
+        "content_len": 257,
+        "reasoning_len": 689,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 3.162,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.456,
+        "content_len": 299,
+        "reasoning_len": 401,
+        "completion_tokens": 309,
+        "total_tokens": 337,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 13.385,
+        "content_len": 174,
+        "reasoning_len": 557,
+        "completion_tokens": 384,
+        "total_tokens": 417,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c4_n1/server.log"
+  },
+  {
+    "label": "c4_n2",
+    "c": 4,
+    "n": 2,
+    "mtp": true,
+    "port": 19512,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 1936,
+    "wall_sec": 27.591,
+    "api_completion_tokens_per_sec": 70.167,
+    "server": {
+      "draft_acceptance_events": 8,
+      "draft_acceptance_weighted": 0.905764,
+      "draft_accepted_tokens": 990,
+      "draft_generated_tokens": 1093,
+      "eval_tokens": 2197,
+      "eval_ms": 92705.84,
+      "eval_tokens_per_sec": 23.699,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 6.853,
+        "content_len": 54,
+        "reasoning_len": 135,
+        "completion_tokens": 115,
+        "total_tokens": 141,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.272,
+        "content_len": 40,
+        "reasoning_len": 150,
+        "completion_tokens": 104,
+        "total_tokens": 134,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 15.792,
+        "content_len": 420,
+        "reasoning_len": 344,
+        "completion_tokens": 307,
+        "total_tokens": 347,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 17.237,
+        "content_len": 42,
+        "reasoning_len": 440,
+        "completion_tokens": 292,
+        "total_tokens": 331,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.952,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 20.345,
+        "content_len": 134,
+        "reasoning_len": 769,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.618,
+        "content_len": 312,
+        "reasoning_len": 469,
+        "completion_tokens": 333,
+        "total_tokens": 361,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.797,
+        "content_len": 230,
+        "reasoning_len": 379,
+        "completion_tokens": 342,
+        "total_tokens": 375,
+        "finish_reason": "stop"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c4_n2/server.log"
+  },
+  {
+    "label": "c4_n3",
+    "c": 4,
+    "n": 3,
+    "mtp": true,
+    "port": 19513,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 1884,
+    "wall_sec": 26.353,
+    "api_completion_tokens_per_sec": 71.49,
+    "server": {
+      "draft_acceptance_events": 8,
+      "draft_acceptance_weighted": 0.896641,
+      "draft_accepted_tokens": 1041,
+      "draft_generated_tokens": 1161,
+      "eval_tokens": 2145,
+      "eval_ms": 84487.09,
+      "eval_tokens_per_sec": 25.388,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 6.388,
+        "content_len": 56,
+        "reasoning_len": 146,
+        "completion_tokens": 120,
+        "total_tokens": 146,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.334,
+        "content_len": 28,
+        "reasoning_len": 203,
+        "completion_tokens": 128,
+        "total_tokens": 158,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 13.813,
+        "content_len": 425,
+        "reasoning_len": 272,
+        "completion_tokens": 286,
+        "total_tokens": 326,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 15.056,
+        "content_len": 68,
+        "reasoning_len": 336,
+        "completion_tokens": 232,
+        "total_tokens": 271,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 18.0,
+        "content_len": 275,
+        "reasoning_len": 663,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.947,
+        "content_len": 5,
+        "reasoning_len": 80,
+        "completion_tokens": 61,
+        "total_tokens": 90,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.123,
+        "content_len": 208,
+        "reasoning_len": 493,
+        "completion_tokens": 289,
+        "total_tokens": 317,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.539,
+        "content_len": 245,
+        "reasoning_len": 475,
+        "completion_tokens": 384,
+        "total_tokens": 417,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c4_n3/server.log"
+  },
+  {
+    "label": "c4_n4",
+    "c": 4,
+    "n": 4,
+    "mtp": true,
+    "port": 19514,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 1924,
+    "wall_sec": 27.449,
+    "api_completion_tokens_per_sec": 70.093,
+    "server": {
+      "draft_acceptance_events": 8,
+      "draft_acceptance_weighted": 0.86089,
+      "draft_accepted_tokens": 1083,
+      "draft_generated_tokens": 1258,
+      "eval_tokens": 2185,
+      "eval_ms": 97838.29,
+      "eval_tokens_per_sec": 22.333,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 7.28,
+        "content_len": 54,
+        "reasoning_len": 139,
+        "completion_tokens": 117,
+        "total_tokens": 143,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 14.234,
+        "content_len": 60,
+        "reasoning_len": 328,
+        "completion_tokens": 229,
+        "total_tokens": 268,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 16.753,
+        "content_len": 231,
+        "reasoning_len": 706,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.821,
+        "content_len": 57,
+        "reasoning_len": 308,
+        "completion_tokens": 194,
+        "total_tokens": 224,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.471,
+        "content_len": 5,
+        "reasoning_len": 72,
+        "completion_tokens": 57,
+        "total_tokens": 86,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 23.321,
+        "content_len": 23,
+        "reasoning_len": 854,
+        "completion_tokens": 384,
+        "total_tokens": 424,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.757,
+        "content_len": 208,
+        "reasoning_len": 518,
+        "completion_tokens": 298,
+        "total_tokens": 326,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.693,
+        "content_len": 71,
+        "reasoning_len": 409,
+        "completion_tokens": 261,
+        "total_tokens": 294,
+        "finish_reason": "stop"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c4_n4/server.log"
+  }
+]

GGUF/Q5_LynnStyle/eval/mtp/mtp_acceptance_matrix.md ADDED Viewed

	@@ -0,0 +1,19 @@

+# MTP Acceptance Matrix
+| C | N | MTP | ok/req | nonempty any/content | api tok/s | server tok/s | draft acceptance | speedup vs no MTP |
+|---:|---:|:---:|---:|---:|---:|---:|---:|---:|
+| 1 |  | off | 4/4 | 4/4 | 54.553 | 63.672 | None | None |
+| 1 | 1 | on | 4/4 | 4/3 | 61.588 | 72.039 | 0.931034 | 1.129 |
+| 1 | 2 | on | 4/4 | 4/4 | 66.44 | 78.602 | 0.928943 | 1.218 |
+| 1 | 3 | on | 4/4 | 4/4 | 68.078 | 80.818 | 0.895928 | 1.248 |
+| 1 | 4 | on | 4/4 | 4/4 | 67.097 | 79.43 | 0.860759 | 1.23 |
+| 2 |  | off | 4/4 | 4/3 | 71.172 | 52.3 | None | None |
+| 2 | 1 | on | 4/4 | 4/4 | 65.157 | 39.408 | 0.941634 | 0.915 |
+| 2 | 2 | on | 4/4 | 4/4 | 73.264 | 46.985 | 0.928687 | 1.029 |
+| 2 | 3 | on | 4/4 | 4/4 | 69.29 | 45.416 | 0.918033 | 0.974 |
+| 2 | 4 | on | 4/4 | 4/4 | 76.176 | 47.76 | 0.874525 | 1.07 |
+| 4 |  | off | 8/8 | 8/8 | 100.98 | 35.217 | None | None |
+| 4 | 1 | on | 8/8 | 8/8 | 66.023 | 22.0 | 0.931896 | 0.654 |
+| 4 | 2 | on | 8/8 | 8/8 | 70.167 | 23.699 | 0.905764 | 0.695 |
+| 4 | 3 | on | 8/8 | 8/8 | 71.49 | 25.388 | 0.896641 | 0.708 |
+| 4 | 4 | on | 8/8 | 8/8 | 70.093 | 22.333 | 0.86089 | 0.694 |

GGUF/Q5_LynnStyle/eval/mtp/mtp_settings.json ADDED Viewed

	@@ -0,0 +1,25 @@

+{
+  "tier": "q5",
+  "target": "Q5_LYNN_DENSE",
+  "model": "/root/autodl-tmp/step37-27b-distill/quantized/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding/GGUF-LynnStyle-v2calib/Q5_LYNN_DENSE/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q5_LYNN_DENSE.gguf",
+  "draft_model": "/root/autodl-tmp/step37-27b-distill/quantized/step37-27b-dsv4pro-official-mtp/MTP/step37-27b-official-mtp-q8_0.gguf",
+  "matrix": {
+    "c_values": "1,2,4",
+    "n_values": "1,2,3,4",
+    "ctx_per_slot": 4096,
+    "max_tokens": 384,
+    "request_timeout_sec": 240.0,
+    "temperature": 0.1,
+    "top_p": 0.95,
+    "spec_draft_p_min": 0.6
+  },
+  "selected_eval_route": {
+    "source": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/selected_eval_route.json",
+    "parallel_c": 4,
+    "mtp_n": null,
+    "mtp_enabled": false,
+    "ctx_total": 32768
+  },
+  "note": "C1/C2/C4 TPS and N=1/2/3/4 MTP acceptance matrix; full rows are in mtp_acceptance_matrix.json.",
+  "generated_at": "2026-07-06T11:24:14+0800"
+}

GGUF/Q5_LynnStyle/eval/mtp/selected_eval_route.json ADDED Viewed

	@@ -0,0 +1,271 @@

+{
+  "chosen": {
+    "label": "c4_nomtp",
+    "c": 4,
+    "n": null,
+    "mtp": false,
+    "port": 19510,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 1957,
+    "wall_sec": 19.38,
+    "api_completion_tokens_per_sec": 100.98,
+    "server": {
+      "draft_acceptance_events": 0,
+      "draft_acceptance_weighted": null,
+      "draft_accepted_tokens": null,
+      "draft_generated_tokens": null,
+      "eval_tokens": 2218,
+      "eval_ms": 62981.58,
+      "eval_tokens_per_sec": 35.217,
+      "model_loaded": true,
+      "mtp_initialized": false
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 4.316,
+        "content_len": 68,
+        "reasoning_len": 136,
+        "completion_tokens": 123,
+        "total_tokens": 149,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.133,
+        "content_len": 61,
+        "reasoning_len": 282,
+        "completion_tokens": 203,
+        "total_tokens": 242,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.283,
+        "content_len": 217,
+        "reasoning_len": 440,
+        "completion_tokens": 262,
+        "total_tokens": 302,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.102,
+        "content_len": 42,
+        "reasoning_len": 248,
+        "completion_tokens": 158,
+        "total_tokens": 188,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.258,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 13.797,
+        "content_len": 260,
+        "reasoning_len": 691,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.238,
+        "content_len": 258,
+        "reasoning_len": 604,
+        "completion_tokens": 384,
+        "total_tokens": 412,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.095,
+        "content_len": 85,
+        "reasoning_len": 620,
+        "completion_tokens": 384,
+        "total_tokens": 417,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c4_nomtp/server.log"
+  },
+  "fastest_mtp": {
+    "label": "c2_n4",
+    "c": 2,
+    "n": 4,
+    "mtp": true,
+    "port": 19509,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1112,
+    "wall_sec": 14.598,
+    "api_completion_tokens_per_sec": 76.176,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.874525,
+      "draft_accepted_tokens": 690,
+      "draft_generated_tokens": 789,
+      "eval_tokens": 1253,
+      "eval_ms": 26235.45,
+      "eval_tokens_per_sec": 47.76,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.556,
+        "content_len": 69,
+        "reasoning_len": 136,
+        "completion_tokens": 122,
+        "total_tokens": 148,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.809,
+        "content_len": 425,
+        "reasoning_len": 406,
+        "completion_tokens": 322,
+        "total_tokens": 362,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 8.542,
+        "content_len": 82,
+        "reasoning_len": 389,
+        "completion_tokens": 284,
+        "total_tokens": 323,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.787,
+        "content_len": 400,
+        "reasoning_len": 438,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c2_n4/server.log"
+  },
+  "fastest_no_mtp": {
+    "label": "c4_nomtp",
+    "c": 4,
+    "n": null,
+    "mtp": false,
+    "port": 19510,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 1957,
+    "wall_sec": 19.38,
+    "api_completion_tokens_per_sec": 100.98,
+    "server": {
+      "draft_acceptance_events": 0,
+      "draft_acceptance_weighted": null,
+      "draft_accepted_tokens": null,
+      "draft_generated_tokens": null,
+      "eval_tokens": 2218,
+      "eval_ms": 62981.58,
+      "eval_tokens_per_sec": 35.217,
+      "model_loaded": true,
+      "mtp_initialized": false
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 4.316,
+        "content_len": 68,
+        "reasoning_len": 136,
+        "completion_tokens": 123,
+        "total_tokens": 149,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.133,
+        "content_len": 61,
+        "reasoning_len": 282,
+        "completion_tokens": 203,
+        "total_tokens": 242,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.283,
+        "content_len": 217,
+        "reasoning_len": 440,
+        "completion_tokens": 262,
+        "total_tokens": 302,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.102,
+        "content_len": 42,
+        "reasoning_len": 248,
+        "completion_tokens": 158,
+        "total_tokens": 188,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.258,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 13.797,
+        "content_len": 260,
+        "reasoning_len": 691,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.238,
+        "content_len": 258,
+        "reasoning_len": 604,
+        "completion_tokens": 384,
+        "total_tokens": 412,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.095,
+        "content_len": 85,
+        "reasoning_len": 620,
+        "completion_tokens": 384,
+        "total_tokens": 417,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/c4_nomtp/server.log"
+  },
+  "stable_rows": 15,
+  "source": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/Q5_LYNN_DENSE_mtp_acceptance_matrix/mtp_acceptance_matrix.json"
+}

GGUF/Q5_LynnStyle/eval/quality_mtp_smoke.summary.json ADDED Viewed

	@@ -0,0 +1,20 @@

+{
+  "target": "Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q5_LYNN_DENSE",
+  "n": 3,
+  "ok": 3,
+  "all_ok": true,
+  "hf_mtp_sidecar_exists": false,
+  "hf_mtp_sidecar_bytes": null,
+  "gguf_mtp_server": {
+    "mtp_requested": true,
+    "mtp_enabled": false,
+    "spec_type": "draft-mtp",
+    "n_max": 1,
+    "p_min": 0.6,
+    "draft_model": null,
+    "draft_model_bytes": null
+  },
+  "split_mtp_draft_gguf_exists": false,
+  "split_mtp_draft_gguf_bytes": null,
+  "generated_at": "2026-07-06T11:24:34+0800"
+}

GGUF/Q5_LynnStyle/lynnstyle/q5_tensor_type_match_report.md ADDED Viewed

	@@ -0,0 +1,531 @@

+# 27B Dense tensor-type match report
+tier: q5
+config: /root/autodl-tmp/step37-27b-distill/models/Qwen3.6-27B-DSV4Pro-GLM-55XH-Coding-SFT-RL-Final55True-v3-merged-bf16/config.json
+gguf: /root/autodl-tmp/step37-27b-distill/quantized/Qwen3.6-27B-DSV4Pro-GLM-55XH-Coding-SFT-RL-Final55True-v3/Q8_0/Qwen3.6-27B-DSV4Pro-GLM-55XH-Coding-SFT-RL-Final55True-v3-Q8_0.gguf
+num_tensor_names_seen: 755
+## early layers q8_0 hard protect
+rule: `^blk\.(0|1|2|3)\..*\.weight=q8_0`
+matches: 47
+- blk.0.attn_gate.weight
+- blk.0.attn_norm.weight
+- blk.0.attn_qkv.weight
+- blk.0.ffn_down.weight
+- blk.0.ffn_gate.weight
+- blk.0.ffn_up.weight
+- blk.0.post_attention_norm.weight
+- blk.0.ssm_alpha.weight
+- blk.0.ssm_beta.weight
+- blk.0.ssm_conv1d.weight
+- blk.0.ssm_norm.weight
+- blk.0.ssm_out.weight
+- blk.1.attn_gate.weight
+- blk.1.attn_norm.weight
+- blk.1.attn_qkv.weight
+- blk.1.ffn_down.weight
+- blk.1.ffn_gate.weight
+- blk.1.ffn_up.weight
+- blk.1.post_attention_norm.weight
+- blk.1.ssm_alpha.weight
+- blk.1.ssm_beta.weight
+- blk.1.ssm_conv1d.weight
+- blk.1.ssm_norm.weight
+- blk.1.ssm_out.weight
+- blk.2.attn_gate.weight
+- blk.2.attn_norm.weight
+- blk.2.attn_qkv.weight
+- blk.2.ffn_down.weight
+- blk.2.ffn_gate.weight
+- blk.2.ffn_up.weight
+- blk.2.post_attention_norm.weight
+- blk.2.ssm_alpha.weight
+- blk.2.ssm_beta.weight
+- blk.2.ssm_conv1d.weight
+- blk.2.ssm_norm.weight
+- blk.2.ssm_out.weight
+- blk.3.attn_k.weight
+- blk.3.attn_k_norm.weight
+- blk.3.attn_norm.weight
+- blk.3.attn_output.weight
+- blk.3.attn_q.weight
+- blk.3.attn_q_norm.weight
+- blk.3.attn_v.weight
+- blk.3.ffn_down.weight
+- blk.3.ffn_gate.weight
+- blk.3.ffn_up.weight
+- blk.3.post_attention_norm.weight
+## last four layers q8_0 hard protect
+rule: `^blk\.(60|61|62|63)\..*\.weight=q8_0`
+matches: 47
+- blk.60.attn_gate.weight
+- blk.60.attn_norm.weight
+- blk.60.attn_qkv.weight
+- blk.60.ffn_down.weight
+- blk.60.ffn_gate.weight
+- blk.60.ffn_up.weight
+- blk.60.post_attention_norm.weight
+- blk.60.ssm_alpha.weight
+- blk.60.ssm_beta.weight
+- blk.60.ssm_conv1d.weight
+- blk.60.ssm_norm.weight
+- blk.60.ssm_out.weight
+- blk.61.attn_gate.weight
+- blk.61.attn_norm.weight
+- blk.61.attn_qkv.weight
+- blk.61.ffn_down.weight
+- blk.61.ffn_gate.weight
+- blk.61.ffn_up.weight
+- blk.61.post_attention_norm.weight
+- blk.61.ssm_alpha.weight
+- blk.61.ssm_beta.weight
+- blk.61.ssm_conv1d.weight
+- blk.61.ssm_norm.weight
+- blk.61.ssm_out.weight
+- blk.62.attn_gate.weight
+- blk.62.attn_norm.weight
+- blk.62.attn_qkv.weight
+- blk.62.ffn_down.weight
+- blk.62.ffn_gate.weight
+- blk.62.ffn_up.weight
+- blk.62.post_attention_norm.weight
+- blk.62.ssm_alpha.weight
+- blk.62.ssm_beta.weight
+- blk.62.ssm_conv1d.weight
+- blk.62.ssm_norm.weight
+- blk.62.ssm_out.weight
+- blk.63.attn_k.weight
+- blk.63.attn_k_norm.weight
+- blk.63.attn_norm.weight
+- blk.63.attn_output.weight
+- blk.63.attn_q.weight
+- blk.63.attn_q_norm.weight
+- blk.63.attn_v.weight
+- blk.63.ffn_down.weight
+- blk.63.ffn_gate.weight
+- blk.63.ffn_up.weight
+- blk.63.post_attention_norm.weight
+## late shoulder layers q6_k protect
+rule: `^blk\.(56|57|58|59)\..*\.weight=q6_k`
+matches: 47
+- blk.56.attn_gate.weight
+- blk.56.attn_norm.weight
+- blk.56.attn_qkv.weight
+- blk.56.ffn_down.weight
+- blk.56.ffn_gate.weight
+- blk.56.ffn_up.weight
+- blk.56.post_attention_norm.weight
+- blk.56.ssm_alpha.weight
+- blk.56.ssm_beta.weight
+- blk.56.ssm_conv1d.weight
+- blk.56.ssm_norm.weight
+- blk.56.ssm_out.weight
+- blk.57.attn_gate.weight
+- blk.57.attn_norm.weight
+- blk.57.attn_qkv.weight
+- blk.57.ffn_down.weight
+- blk.57.ffn_gate.weight
+- blk.57.ffn_up.weight
+- blk.57.post_attention_norm.weight
+- blk.57.ssm_alpha.weight
+- blk.57.ssm_beta.weight
+- blk.57.ssm_conv1d.weight
+- blk.57.ssm_norm.weight
+- blk.57.ssm_out.weight
+- blk.58.attn_gate.weight
+- blk.58.attn_norm.weight
+- blk.58.attn_qkv.weight
+- blk.58.ffn_down.weight
+- blk.58.ffn_gate.weight
+- blk.58.ffn_up.weight
+- blk.58.post_attention_norm.weight
+- blk.58.ssm_alpha.weight
+- blk.58.ssm_beta.weight
+- blk.58.ssm_conv1d.weight
+- blk.58.ssm_norm.weight
+- blk.58.ssm_out.weight
+- blk.59.attn_k.weight
+- blk.59.attn_k_norm.weight
+- blk.59.attn_norm.weight
+- blk.59.attn_output.weight
+- blk.59.attn_q.weight
+- blk.59.attn_q_norm.weight
+- blk.59.attn_v.weight
+- blk.59.ffn_down.weight
+- blk.59.ffn_gate.weight
+- blk.59.ffn_up.weight
+- blk.59.post_attention_norm.weight
+## middle full-attention projections q5_k protect
+rule: `^blk\.(7|11|15|19|23|27|31|35|39|43|47|51|55)\.(attn_q|attn_k|attn_v|attn_output)\.weight=q5_k`
+matches: 52
+- blk.11.attn_k.weight
+- blk.11.attn_output.weight
+- blk.11.attn_q.weight
+- blk.11.attn_v.weight
+- blk.15.attn_k.weight
+- blk.15.attn_output.weight
+- blk.15.attn_q.weight
+- blk.15.attn_v.weight
+- blk.19.attn_k.weight
+- blk.19.attn_output.weight
+- blk.19.attn_q.weight
+- blk.19.attn_v.weight
+- blk.23.attn_k.weight
+- blk.23.attn_output.weight
+- blk.23.attn_q.weight
+- blk.23.attn_v.weight
+- blk.27.attn_k.weight
+- blk.27.attn_output.weight
+- blk.27.attn_q.weight
+- blk.27.attn_v.weight
+- blk.31.attn_k.weight
+- blk.31.attn_output.weight
+- blk.31.attn_q.weight
+- blk.31.attn_v.weight
+- blk.35.attn_k.weight
+- blk.35.attn_output.weight
+- blk.35.attn_q.weight
+- blk.35.attn_v.weight
+- blk.39.attn_k.weight
+- blk.39.attn_output.weight
+- blk.39.attn_q.weight
+- blk.39.attn_v.weight
+- blk.43.attn_k.weight
+- blk.43.attn_output.weight
+- blk.43.attn_q.weight
+- blk.43.attn_v.weight
+- blk.47.attn_k.weight
+- blk.47.attn_output.weight
+- blk.47.attn_q.weight
+- blk.47.attn_v.weight
+- blk.51.attn_k.weight
+- blk.51.attn_output.weight
+- blk.51.attn_q.weight
+- blk.51.attn_v.weight
+- blk.55.attn_k.weight
+- blk.55.attn_output.weight
+- blk.55.attn_q.weight
+- blk.55.attn_v.weight
+- blk.7.attn_k.weight
+- blk.7.attn_output.weight
+- blk.7.attn_q.weight
+- blk.7.attn_v.weight
+## middle linear-attention gates q5_k protect
+rule: `^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.attn_gate\.weight=q5_k`
+matches: 39
+- blk.10.attn_gate.weight
+- blk.12.attn_gate.weight
+- blk.13.attn_gate.weight
+- blk.14.attn_gate.weight
+- blk.16.attn_gate.weight
+- blk.17.attn_gate.weight
+- blk.18.attn_gate.weight
+- blk.20.attn_gate.weight
+- blk.21.attn_gate.weight
+- blk.22.attn_gate.weight
+- blk.24.attn_gate.weight
+- blk.25.attn_gate.weight
+- blk.26.attn_gate.weight
+- blk.28.attn_gate.weight
+- blk.29.attn_gate.weight
+- blk.30.attn_gate.weight
+- blk.32.attn_gate.weight
+- blk.33.attn_gate.weight
+- blk.34.attn_gate.weight
+- blk.36.attn_gate.weight
+- blk.37.attn_gate.weight
+- blk.38.attn_gate.weight
+- blk.4.attn_gate.weight
+- blk.40.attn_gate.weight
+- blk.41.attn_gate.weight
+- blk.42.attn_gate.weight
+- blk.44.attn_gate.weight
+- blk.45.attn_gate.weight
+- blk.46.attn_gate.weight
+- blk.48.attn_gate.weight
+- blk.49.attn_gate.weight
+- blk.5.attn_gate.weight
+- blk.50.attn_gate.weight
+- blk.52.attn_gate.weight
+- blk.53.attn_gate.weight
+- blk.54.attn_gate.weight
+- blk.6.attn_gate.weight
+- blk.8.attn_gate.weight
+- blk.9.attn_gate.weight
+## middle linear-attention qkv q5_k protect
+rule: `^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.attn_qkv\.weight=q5_k`
+matches: 39
+- blk.10.attn_qkv.weight
+- blk.12.attn_qkv.weight
+- blk.13.attn_qkv.weight
+- blk.14.attn_qkv.weight
+- blk.16.attn_qkv.weight
+- blk.17.attn_qkv.weight
+- blk.18.attn_qkv.weight
+- blk.20.attn_qkv.weight
+- blk.21.attn_qkv.weight
+- blk.22.attn_qkv.weight
+- blk.24.attn_qkv.weight
+- blk.25.attn_qkv.weight
+- blk.26.attn_qkv.weight
+- blk.28.attn_qkv.weight
+- blk.29.attn_qkv.weight
+- blk.30.attn_qkv.weight
+- blk.32.attn_qkv.weight
+- blk.33.attn_qkv.weight
+- blk.34.attn_qkv.weight
+- blk.36.attn_qkv.weight
+- blk.37.attn_qkv.weight
+- blk.38.attn_qkv.weight
+- blk.4.attn_qkv.weight
+- blk.40.attn_qkv.weight
+- blk.41.attn_qkv.weight
+- blk.42.attn_qkv.weight
+- blk.44.attn_qkv.weight
+- blk.45.attn_qkv.weight
+- blk.46.attn_qkv.weight
+- blk.48.attn_qkv.weight
+- blk.49.attn_qkv.weight
+- blk.5.attn_qkv.weight
+- blk.50.attn_qkv.weight
+- blk.52.attn_qkv.weight
+- blk.53.attn_qkv.weight
+- blk.54.attn_qkv.weight
+- blk.6.attn_qkv.weight
+- blk.8.attn_qkv.weight
+- blk.9.attn_qkv.weight
+## middle SSM tensor family q5_k protect
+rule: `^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.ssm_(alpha|beta|conv1d|norm|out)\.weight=q5_k`
+matches: 195
+- blk.10.ssm_alpha.weight
+- blk.10.ssm_beta.weight
+- blk.10.ssm_conv1d.weight
+- blk.10.ssm_norm.weight
+- blk.10.ssm_out.weight
+- blk.12.ssm_alpha.weight
+- blk.12.ssm_beta.weight
+- blk.12.ssm_conv1d.weight
+- blk.12.ssm_norm.weight
+- blk.12.ssm_out.weight
+- blk.13.ssm_alpha.weight
+- blk.13.ssm_beta.weight
+- blk.13.ssm_conv1d.weight
+- blk.13.ssm_norm.weight
+- blk.13.ssm_out.weight
+- blk.14.ssm_alpha.weight
+- blk.14.ssm_beta.weight
+- blk.14.ssm_conv1d.weight
+- blk.14.ssm_norm.weight
+- blk.14.ssm_out.weight
+- blk.16.ssm_alpha.weight
+- blk.16.ssm_beta.weight
+- blk.16.ssm_conv1d.weight
+- blk.16.ssm_norm.weight
+- blk.16.ssm_out.weight
+- blk.17.ssm_alpha.weight
+- blk.17.ssm_beta.weight
+- blk.17.ssm_conv1d.weight
+- blk.17.ssm_norm.weight
+- blk.17.ssm_out.weight
+- blk.18.ssm_alpha.weight
+- blk.18.ssm_beta.weight
+- blk.18.ssm_conv1d.weight
+- blk.18.ssm_norm.weight
+- blk.18.ssm_out.weight
+- blk.20.ssm_alpha.weight
+- blk.20.ssm_beta.weight
+- blk.20.ssm_conv1d.weight
+- blk.20.ssm_norm.weight
+- blk.20.ssm_out.weight
+- blk.21.ssm_alpha.weight
+- blk.21.ssm_beta.weight
+- blk.21.ssm_conv1d.weight
+- blk.21.ssm_norm.weight
+- blk.21.ssm_out.weight
+- blk.22.ssm_alpha.weight
+- blk.22.ssm_beta.weight
+- blk.22.ssm_conv1d.weight
+- blk.22.ssm_norm.weight
+- blk.22.ssm_out.weight
+- blk.24.ssm_alpha.weight
+- blk.24.ssm_beta.weight
+- blk.24.ssm_conv1d.weight
+- blk.24.ssm_norm.weight
+- blk.24.ssm_out.weight
+- blk.25.ssm_alpha.weight
+- blk.25.ssm_beta.weight
+- blk.25.ssm_conv1d.weight
+- blk.25.ssm_norm.weight
+- blk.25.ssm_out.weight
+- blk.26.ssm_alpha.weight
+- blk.26.ssm_beta.weight
+- blk.26.ssm_conv1d.weight
+- blk.26.ssm_norm.weight
+- blk.26.ssm_out.weight
+- blk.28.ssm_alpha.weight
+- blk.28.ssm_beta.weight
+- blk.28.ssm_conv1d.weight
+- blk.28.ssm_norm.weight
+- blk.28.ssm_out.weight
+- blk.29.ssm_alpha.weight
+- blk.29.ssm_beta.weight
+- blk.29.ssm_conv1d.weight
+- blk.29.ssm_norm.weight
+- blk.29.ssm_out.weight
+- blk.30.ssm_alpha.weight
+- blk.30.ssm_beta.weight
+- blk.30.ssm_conv1d.weight
+- blk.30.ssm_norm.weight
+- blk.30.ssm_out.weight
+- blk.32.ssm_alpha.weight
+- blk.32.ssm_beta.weight
+- blk.32.ssm_conv1d.weight
+- blk.32.ssm_norm.weight
+- blk.32.ssm_out.weight
+- blk.33.ssm_alpha.weight
+- blk.33.ssm_beta.weight
+- blk.33.ssm_conv1d.weight
+- blk.33.ssm_norm.weight
+- blk.33.ssm_out.weight
+- blk.34.ssm_alpha.weight
+- blk.34.ssm_beta.weight
+- blk.34.ssm_conv1d.weight
+- blk.34.ssm_norm.weight
+- blk.34.ssm_out.weight
+- blk.36.ssm_alpha.weight
+- blk.36.ssm_beta.weight
+- blk.36.ssm_conv1d.weight
+- blk.36.ssm_norm.weight
+- blk.36.ssm_out.weight
+- blk.37.ssm_alpha.weight
+- blk.37.ssm_beta.weight
+- blk.37.ssm_conv1d.weight
+- blk.37.ssm_norm.weight
+- blk.37.ssm_out.weight
+- blk.38.ssm_alpha.weight
+- blk.38.ssm_beta.weight
+- blk.38.ssm_conv1d.weight
+- blk.38.ssm_norm.weight
+- blk.38.ssm_out.weight
+- blk.4.ssm_alpha.weight
+- blk.4.ssm_beta.weight
+- blk.4.ssm_conv1d.weight
+- blk.4.ssm_norm.weight
+- blk.4.ssm_out.weight
+- blk.40.ssm_alpha.weight
+- blk.40.ssm_beta.weight
+- blk.40.ssm_conv1d.weight
+- blk.40.ssm_norm.weight
+- blk.40.ssm_out.weight
+- blk.41.ssm_alpha.weight
+- blk.41.ssm_beta.weight
+- blk.41.ssm_conv1d.weight
+- blk.41.ssm_norm.weight
+- blk.41.ssm_out.weight
+- blk.42.ssm_alpha.weight
+- blk.42.ssm_beta.weight
+- blk.42.ssm_conv1d.weight
+- blk.42.ssm_norm.weight
+- blk.42.ssm_out.weight
+- blk.44.ssm_alpha.weight
+- blk.44.ssm_beta.weight
+- blk.44.ssm_conv1d.weight
+- blk.44.ssm_norm.weight
+- blk.44.ssm_out.weight
+- blk.45.ssm_alpha.weight
+- blk.45.ssm_beta.weight
+- blk.45.ssm_conv1d.weight
+- blk.45.ssm_norm.weight
+- blk.45.ssm_out.weight
+- blk.46.ssm_alpha.weight
+- blk.46.ssm_beta.weight
+- blk.46.ssm_conv1d.weight
+- blk.46.ssm_norm.weight
+- blk.46.ssm_out.weight
+- blk.48.ssm_alpha.weight
+- blk.48.ssm_beta.weight
+- blk.48.ssm_conv1d.weight
+- blk.48.ssm_norm.weight
+- blk.48.ssm_out.weight
+- blk.49.ssm_alpha.weight
+- blk.49.ssm_beta.weight
+- blk.49.ssm_conv1d.weight
+- blk.49.ssm_norm.weight
+- blk.49.ssm_out.weight
+- blk.5.ssm_alpha.weight
+- blk.5.ssm_beta.weight
+- blk.5.ssm_conv1d.weight
+- blk.5.ssm_norm.weight
+- blk.5.ssm_out.weight
+- blk.50.ssm_alpha.weight
+- blk.50.ssm_beta.weight
+- blk.50.ssm_conv1d.weight
+- blk.50.ssm_norm.weight
+- blk.50.ssm_out.weight
+- blk.52.ssm_alpha.weight
+- blk.52.ssm_beta.weight
+- blk.52.ssm_conv1d.weight
+- blk.52.ssm_norm.weight
+- blk.52.ssm_out.weight
+- blk.53.ssm_alpha.weight
+- blk.53.ssm_beta.weight
+- blk.53.ssm_conv1d.weight
+- blk.53.ssm_norm.weight
+- blk.53.ssm_out.weight
+- blk.54.ssm_alpha.weight
+- blk.54.ssm_beta.weight
+- blk.54.ssm_conv1d.weight
+- blk.54.ssm_norm.weight
+- blk.54.ssm_out.weight
+- blk.6.ssm_alpha.weight
+- blk.6.ssm_beta.weight
+- blk.6.ssm_conv1d.weight
+- blk.6.ssm_norm.weight
+- blk.6.ssm_out.weight
+- blk.8.ssm_alpha.weight
+- blk.8.ssm_beta.weight
+- blk.8.ssm_conv1d.weight
+- blk.8.ssm_norm.weight
+- blk.8.ssm_out.weight
+- blk.9.ssm_alpha.weight
+- blk.9.ssm_beta.weight
+- blk.9.ssm_conv1d.weight
+- blk.9.ssm_norm.weight
+- blk.9.ssm_out.weight
+## Quantize command shape
+Use with final accepted BF16 GGUF, not an intermediate candidate:
+```bash
+llama-quantize --imatrix CALIB.imatrix --output-tensor-type q8_0 --token-embedding-type q8_0 --tensor-type-file /root/autodl-tmp/step37-27b-distill/runs/146_27b_Q5_LYNN_DENSE_quality_cycle_20260705/q5_tensor_types.txt MODEL-F16.gguf MODEL-Q4_K_M-LynnDense.gguf q4_k_m THREADS
+```
+Run `--dry-run` first and archive the dry-run log.

GGUF/Q5_LynnStyle/lynnstyle/q5_tensor_types.txt ADDED Viewed

	@@ -0,0 +1,7 @@

+^blk\.(0|1|2|3)\..*\.weight=q8_0
+^blk\.(60|61|62|63)\..*\.weight=q8_0
+^blk\.(56|57|58|59)\..*\.weight=q6_k
+^blk\.(7|11|15|19|23|27|31|35|39|43|47|51|55)\.(attn_q|attn_k|attn_v|attn_output)\.weight=q5_k
+^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.attn_gate\.weight=q5_k
+^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.attn_qkv\.weight=q5_k
+^blk\.(4|5|6|7|8|9|10|11|12|13|14|15|16|17|18|19|20|21|22|23|24|25|26|27|28|29|30|31|32|33|34|35|36|37|38|39|40|41|42|43|44|45|46|47|48|49|50|51|52|53|54|55)\.ssm_(alpha|beta|conv1d|norm|out)\.weight=q5_k

GGUF/Q5_LynnStyle/lynnstyle/quant_manifest.json ADDED Viewed

	@@ -0,0 +1,13 @@

+{
+  "tier": "q5",
+  "target": "Q5_LYNN_DENSE",
+  "base_qtype": "Q5_K_M",
+  "file": "/root/autodl-tmp/step37-27b-distill/quantized/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding/GGUF-LynnStyle-v2calib/Q5_LYNN_DENSE/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-Q5_LYNN_DENSE.gguf",
+  "bytes": 21068289440,
+  "sha256": "a2f790fc4352f1aa3b1df3eb3438a31f85ab2b37a039d69ffd3970e8abb6ab61",
+  "tensor_type_file": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/q5_tensor_types.txt",
+  "tensor_match_report": "/root/autodl-tmp/step37-27b-distill/runs/153_27b_q5_lynnstyle_v2calib_lbc30_gate_20260706/q5_tensor_type_match_report.md",
+  "imatrix": "/root/autodl-tmp/step37-27b-distill/quantized/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding/GGUF-LynnStyle-v2calib/imatrix/Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-lynnstyle-interleaved-20260706-ch512.imatrix.gguf",
+  "generated_at": "2026-07-06T11:17:12+0800",
+  "policy": "LynnStyle Dense protected GGUF: layer-position + tensor-family protection, not one-size quantization."
+}

GGUF/Q8_0/Q8-MTP-00001-of-00005.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7c5bce79b27477f5a5dbddaf7e1a724c6f7ccb53daa348c8c7a07a975cd26e28
+size 5981513440

GGUF/Q8_0/Q8-MTP-00002-of-00005.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:74e393ef2f0412d0d42e01b64dd6f918f0ec28ba2ec2a9c7f947a8e962062c8a
+size 5912941280

GGUF/Q8_0/Q8-MTP-00003-of-00005.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:10b1f541d4d786c51375c10cd00cd0c1399a1174abd9f57208afcf91663fec1d
+size 5968690336

GGUF/Q8_0/Q8-MTP-00004-of-00005.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dcbfcaf29622b5199ad69af58560a5959027b14360eedce3bb413a748e5aaa29
+size 5968690336

GGUF/Q8_0/Q8-MTP-00005-of-00005.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:60b9a7b220390e93b515ac80097be14a834a2906414128d30aea1159290ed669
+size 4763927584

GGUF/Q8_0/Q8-MTP-draft.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fb18a96292d43f746b39f2e3e8998e477788b5b7659d98a7cc192e9e753c8fd4
+size 3164005344

GGUF/Q8_0/Q8-MTP.manifest.json ADDED Viewed

	@@ -0,0 +1,13 @@

+{
+  "model": "Qwen3.6-27B-DSV4Pro-GLM52-SFT-GPT55-RL-Coding",
+  "tier": "Q8_0",
+  "file_prefix": "Q8-MTP",
+  "n_split": 5,
+  "files": [
+    "Q8-MTP-00001-of-00005.gguf",    "Q8-MTP-00002-of-00005.gguf",    "Q8-MTP-00003-of-00005.gguf",    "Q8-MTP-00004-of-00005.gguf",    "Q8-MTP-00005-of-00005.gguf"
+  ],
+  "source": "final RL Q8_0 GGUF split with llama-gguf-split --split-max-size 6G",
+  "mtp": "official MTP sidecar uploaded separately",
+  "note": "Q8 is the quality baseline and does not use imatrix calibration; lower tiers use imatrix plus explicit LynnStyle Dense protection.",
+  "generated_at": "2026-07-06T12:41:17+08:00"
+}

GGUF/Q8_0/SHA256SUMS ADDED Viewed

	@@ -0,0 +1,5 @@

+7c5bce79b27477f5a5dbddaf7e1a724c6f7ccb53daa348c8c7a07a975cd26e28  Q8-MTP-00001-of-00005.gguf
+74e393ef2f0412d0d42e01b64dd6f918f0ec28ba2ec2a9c7f947a8e962062c8a  Q8-MTP-00002-of-00005.gguf
+10b1f541d4d786c51375c10cd00cd0c1399a1174abd9f57208afcf91663fec1d  Q8-MTP-00003-of-00005.gguf
+dcbfcaf29622b5199ad69af58560a5959027b14360eedce3bb413a748e5aaa29  Q8-MTP-00004-of-00005.gguf
+60b9a7b220390e93b515ac80097be14a834a2906414128d30aea1159290ed669  Q8-MTP-00005-of-00005.gguf

GGUF/Q8_0/eval/coding100.summary.json ADDED Viewed

	@@ -0,0 +1,25 @@

+{
+  "n": 100,
+  "pass": 88,
+  "accuracy": 0.88,
+  "by_lang": {
+    "bash": "9/10",
+    "cpp": "10/10",
+    "css": "10/10",
+    "go": "8/10",
+    "html": "10/10",
+    "javascript": "6/10",
+    "python": "9/10",
+    "rust": "9/10",
+    "sql": "10/10",
+    "typescript": "7/10"
+  },
+  "notes": {
+    "PASS": 88,
+    "exec-fail": 12
+  },
+  "empty": 0,
+  "api_errors": 0,
+  "created_at_unix": 1783265040.7373385,
+  "harness": "coding100_current_clean_eval_temp06_20260705"
+}

GGUF/Q8_0/eval/gpqa198.summary.json ADDED Viewed

	@@ -0,0 +1,12 @@

+{
+  "n": 198,
+  "correct": 162,
+  "accuracy": 0.8181818181818182,
+  "parse_fail": 0,
+  "errors": 0,
+  "timeouts": 0,
+  "finish_reason_counts": {
+    "stop": 198
+  },
+  "created_at_unix": 1783292095.9993775
+}

GGUF/Q8_0/eval/lbc100.summary.json ADDED Viewed

	@@ -0,0 +1,22 @@

+{
+  "n": 100,
+  "pass": 78,
+  "accuracy": 0.78,
+  "by_difficulty": {
+    "easy:pass": 23,
+    "medium:pass": 30,
+    "hard:fail": 21,
+    "hard:pass": 25,
+    "medium:fail": 1
+  },
+  "notes": {
+    "PASS": 78,
+    "runtime_error_case": 3,
+    "wrong_answer_case": 15,
+    "empty_code": 1,
+    "error": 1,
+    "timeout_case": 2
+  },
+  "empty_or_no_code": 1,
+  "created_at_unix": 1783263716.2930017
+}

GGUF/Q8_0/eval/mmlu500.summary.json ADDED Viewed

	@@ -0,0 +1,12 @@

+{
+  "n": 500,
+  "correct": 462,
+  "accuracy": 0.924,
+  "parse_fail": 0,
+  "errors": 0,
+  "timeouts": 0,
+  "finish_reason_counts": {
+    "stop": 500
+  },
+  "created_at_unix": 1783268110.1715186
+}

GGUF/Q8_0/eval/mtp/matrix.log ADDED Viewed

	@@ -0,0 +1,30 @@

+[matrix] start c1_nomtp port=19680
+[matrix] done c1_nomtp ok=4/4 nonempty_any=4 api_tps=43.54 accept=None
+[matrix] start c1_n1 port=19681
+[matrix] done c1_n1 ok=4/4 nonempty_any=4 api_tps=56.78 accept=0.955734
+[matrix] start c1_n2 port=19682
+[matrix] done c1_n2 ok=4/4 nonempty_any=4 api_tps=64.726 accept=0.923323
+[matrix] start c1_n3 port=19683
+[matrix] done c1_n3 ok=4/4 nonempty_any=4 api_tps=63.877 accept=0.91763
+[matrix] start c1_n4 port=19684
+[matrix] done c1_n4 ok=4/4 nonempty_any=4 api_tps=65.492 accept=0.876302
+[matrix] start c2_nomtp port=19685
+[matrix] done c2_nomtp ok=4/4 nonempty_any=4 api_tps=71.55 accept=None
+[matrix] start c2_n1 port=19686
+[matrix] done c2_n1 ok=4/4 nonempty_any=4 api_tps=59.323 accept=0.952849
+[matrix] start c2_n2 port=19687
+[matrix] done c2_n2 ok=4/4 nonempty_any=4 api_tps=68.406 accept=0.936134
+[matrix] start c2_n3 port=19688
+[matrix] done c2_n3 ok=4/4 nonempty_any=4 api_tps=74.24 accept=0.907433
+[matrix] start c2_n4 port=19689
+[matrix] done c2_n4 ok=4/4 nonempty_any=4 api_tps=72.902 accept=0.862644
+[matrix] start c4_nomtp port=19690
+[matrix] done c4_nomtp ok=8/8 nonempty_any=8 api_tps=87.66 accept=None
+[matrix] start c4_n1 port=19691
+[matrix] done c4_n1 ok=8/8 nonempty_any=8 api_tps=57.636 accept=0.948843
+[matrix] start c4_n2 port=19692
+[matrix] done c4_n2 ok=8/8 nonempty_any=8 api_tps=67.742 accept=0.92243
+[matrix] start c4_n3 port=19693
+[matrix] done c4_n3 ok=8/8 nonempty_any=8 api_tps=71.541 accept=0.90411
+[matrix] start c4_n4 port=19694
+[matrix] done c4_n4 ok=8/8 nonempty_any=8 api_tps=73.192 accept=0.871302

GGUF/Q8_0/eval/mtp/mtp_acceptance_matrix.json ADDED Viewed

	@@ -0,0 +1,1157 @@

+[
+  {
+    "label": "c1_nomtp",
+    "c": 1,
+    "n": null,
+    "mtp": false,
+    "port": 19680,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1104,
+    "wall_sec": 25.356,
+    "api_completion_tokens_per_sec": 43.54,
+    "server": {
+      "draft_acceptance_events": 0,
+      "draft_acceptance_weighted": null,
+      "draft_accepted_tokens": null,
+      "draft_generated_tokens": null,
+      "eval_tokens": 1245,
+      "eval_ms": 24669.2,
+      "eval_tokens_per_sec": 50.468,
+      "model_loaded": true,
+      "mtp_initialized": false
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 2.875,
+        "content_len": 68,
+        "reasoning_len": 138,
+        "completion_tokens": 124,
+        "total_tokens": 150,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.788,
+        "content_len": 227,
+        "reasoning_len": 509,
+        "completion_tokens": 295,
+        "total_tokens": 335,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.928,
+        "content_len": 71,
+        "reasoning_len": 451,
+        "completion_tokens": 301,
+        "total_tokens": 340,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 8.761,
+        "content_len": 218,
+        "reasoning_len": 673,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c1_nomtp/server.log"
+  },
+  {
+    "label": "c1_n1",
+    "c": 1,
+    "n": 1,
+    "mtp": true,
+    "port": 19681,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 3,
+    "nonempty_any": 4,
+    "completion_tokens": 1178,
+    "wall_sec": 20.747,
+    "api_completion_tokens_per_sec": 56.78,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.955734,
+      "draft_accepted_tokens": 475,
+      "draft_generated_tokens": 497,
+      "eval_tokens": 1319,
+      "eval_ms": 20138.42,
+      "eval_tokens_per_sec": 65.497,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 2.389,
+        "content_len": 55,
+        "reasoning_len": 152,
+        "completion_tokens": 126,
+        "total_tokens": 152,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 4.98,
+        "content_len": 355,
+        "reasoning_len": 338,
+        "completion_tokens": 284,
+        "total_tokens": 324,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.031,
+        "content_len": 0,
+        "reasoning_len": 660,
+        "completion_tokens": 384,
+        "total_tokens": 423,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.346,
+        "content_len": 595,
+        "reasoning_len": 324,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c1_n1/server.log"
+  },
+  {
+    "label": "c1_n2",
+    "c": 1,
+    "n": 2,
+    "mtp": true,
+    "port": 19682,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1077,
+    "wall_sec": 16.639,
+    "api_completion_tokens_per_sec": 64.726,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.923323,
+      "draft_accepted_tokens": 578,
+      "draft_generated_tokens": 626,
+      "eval_tokens": 1218,
+      "eval_ms": 15974.41,
+      "eval_tokens_per_sec": 76.247,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 2.069,
+        "content_len": 68,
+        "reasoning_len": 127,
+        "completion_tokens": 119,
+        "total_tokens": 145,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 4.485,
+        "content_len": 440,
+        "reasoning_len": 344,
+        "completion_tokens": 306,
+        "total_tokens": 346,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 4.655,
+        "content_len": 52,
+        "reasoning_len": 405,
+        "completion_tokens": 268,
+        "total_tokens": 307,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.43,
+        "content_len": 349,
+        "reasoning_len": 552,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c1_n2/server.log"
+  },
+  {
+    "label": "c1_n3",
+    "c": 1,
+    "n": 3,
+    "mtp": true,
+    "port": 19683,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 3,
+    "nonempty_any": 4,
+    "completion_tokens": 1155,
+    "wall_sec": 18.082,
+    "api_completion_tokens_per_sec": 63.877,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.91763,
+      "draft_accepted_tokens": 635,
+      "draft_generated_tokens": 692,
+      "eval_tokens": 1296,
+      "eval_ms": 17411.99,
+      "eval_tokens_per_sec": 74.431,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 2.359,
+        "content_len": 75,
+        "reasoning_len": 135,
+        "completion_tokens": 130,
+        "total_tokens": 156,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.573,
+        "content_len": 0,
+        "reasoning_len": 784,
+        "completion_tokens": 384,
+        "total_tokens": 424,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 3.965,
+        "content_len": 54,
+        "reasoning_len": 362,
+        "completion_tokens": 257,
+        "total_tokens": 296,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.184,
+        "content_len": 230,
+        "reasoning_len": 680,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c1_n3/server.log"
+  },
+  {
+    "label": "c1_n4",
+    "c": 1,
+    "n": 4,
+    "mtp": true,
+    "port": 19684,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1146,
+    "wall_sec": 17.498,
+    "api_completion_tokens_per_sec": 65.492,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.876302,
+      "draft_accepted_tokens": 673,
+      "draft_generated_tokens": 768,
+      "eval_tokens": 1287,
+      "eval_ms": 16795.95,
+      "eval_tokens_per_sec": 76.626,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 2.16,
+        "content_len": 54,
+        "reasoning_len": 139,
+        "completion_tokens": 117,
+        "total_tokens": 143,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.064,
+        "content_len": 331,
+        "reasoning_len": 554,
+        "completion_tokens": 365,
+        "total_tokens": 405,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.408,
+        "content_len": 32,
+        "reasoning_len": 618,
+        "completion_tokens": 384,
+        "total_tokens": 423,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 3.866,
+        "content_len": 535,
+        "reasoning_len": 175,
+        "completion_tokens": 280,
+        "total_tokens": 316,
+        "finish_reason": "stop"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c1_n4/server.log"
+  },
+  {
+    "label": "c2_nomtp",
+    "c": 2,
+    "n": null,
+    "mtp": false,
+    "port": 19685,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 3,
+    "nonempty_any": 4,
+    "completion_tokens": 1122,
+    "wall_sec": 15.681,
+    "api_completion_tokens_per_sec": 71.55,
+    "server": {
+      "draft_acceptance_events": 0,
+      "draft_acceptance_weighted": null,
+      "draft_accepted_tokens": null,
+      "draft_generated_tokens": null,
+      "eval_tokens": 1263,
+      "eval_ms": 28279.65,
+      "eval_tokens_per_sec": 44.661,
+      "model_loaded": true,
+      "mtp_initialized": false
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.08,
+        "content_len": 54,
+        "reasoning_len": 137,
+        "completion_tokens": 117,
+        "total_tokens": 143,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.297,
+        "content_len": 228,
+        "reasoning_len": 340,
+        "completion_tokens": 237,
+        "total_tokens": 277,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.968,
+        "content_len": 0,
+        "reasoning_len": 683,
+        "completion_tokens": 384,
+        "total_tokens": 423,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.382,
+        "content_len": 527,
+        "reasoning_len": 382,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c2_nomtp/server.log"
+  },
+  {
+    "label": "c2_n1",
+    "c": 2,
+    "n": 1,
+    "mtp": true,
+    "port": 19686,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1188,
+    "wall_sec": 20.026,
+    "api_completion_tokens_per_sec": 59.323,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.952849,
+      "draft_accepted_tokens": 485,
+      "draft_generated_tokens": 509,
+      "eval_tokens": 1329,
+      "eval_ms": 36690.48,
+      "eval_tokens_per_sec": 36.222,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 4.301,
+        "content_len": 54,
+        "reasoning_len": 135,
+        "completion_tokens": 115,
+        "total_tokens": 141,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.621,
+        "content_len": 338,
+        "reasoning_len": 380,
+        "completion_tokens": 313,
+        "total_tokens": 353,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.873,
+        "content_len": 86,
+        "reasoning_len": 521,
+        "completion_tokens": 376,
+        "total_tokens": 415,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.403,
+        "content_len": 305,
+        "reasoning_len": 625,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c2_n1/server.log"
+  },
+  {
+    "label": "c2_n2",
+    "c": 2,
+    "n": 2,
+    "mtp": true,
+    "port": 19687,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1063,
+    "wall_sec": 15.54,
+    "api_completion_tokens_per_sec": 68.406,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.936134,
+      "draft_accepted_tokens": 557,
+      "draft_generated_tokens": 595,
+      "eval_tokens": 1204,
+      "eval_ms": 29340.66,
+      "eval_tokens_per_sec": 41.035,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.927,
+        "content_len": 57,
+        "reasoning_len": 135,
+        "completion_tokens": 117,
+        "total_tokens": 143,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.9,
+        "content_len": 227,
+        "reasoning_len": 320,
+        "completion_tokens": 232,
+        "total_tokens": 272,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.36,
+        "content_len": 70,
+        "reasoning_len": 492,
+        "completion_tokens": 330,
+        "total_tokens": 369,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 8.638,
+        "content_len": 588,
+        "reasoning_len": 330,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c2_n2/server.log"
+  },
+  {
+    "label": "c2_n3",
+    "c": 2,
+    "n": 3,
+    "mtp": true,
+    "port": 19688,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1081,
+    "wall_sec": 14.561,
+    "api_completion_tokens_per_sec": 74.24,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.907433,
+      "draft_accepted_tokens": 647,
+      "draft_generated_tokens": 713,
+      "eval_tokens": 1222,
+      "eval_ms": 26237.8,
+      "eval_tokens_per_sec": 46.574,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.629,
+        "content_len": 68,
+        "reasoning_len": 127,
+        "completion_tokens": 119,
+        "total_tokens": 145,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.725,
+        "content_len": 372,
+        "reasoning_len": 338,
+        "completion_tokens": 291,
+        "total_tokens": 331,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 8.773,
+        "content_len": 70,
+        "reasoning_len": 412,
+        "completion_tokens": 287,
+        "total_tokens": 326,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 6.834,
+        "content_len": 602,
+        "reasoning_len": 335,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c2_n3/server.log"
+  },
+  {
+    "label": "c2_n4",
+    "c": 2,
+    "n": 4,
+    "mtp": true,
+    "port": 19689,
+    "requests": 4,
+    "ok": 4,
+    "errors": 0,
+    "nonempty_content": 4,
+    "nonempty_any": 4,
+    "completion_tokens": 1132,
+    "wall_sec": 15.528,
+    "api_completion_tokens_per_sec": 72.902,
+    "server": {
+      "draft_acceptance_events": 4,
+      "draft_acceptance_weighted": 0.862644,
+      "draft_accepted_tokens": 672,
+      "draft_generated_tokens": 779,
+      "eval_tokens": 1273,
+      "eval_ms": 26102.89,
+      "eval_tokens_per_sec": 48.769,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.909,
+        "content_len": 63,
+        "reasoning_len": 136,
+        "completion_tokens": 119,
+        "total_tokens": 145,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.975,
+        "content_len": 203,
+        "reasoning_len": 613,
+        "completion_tokens": 384,
+        "total_tokens": 424,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.1,
+        "content_len": 67,
+        "reasoning_len": 350,
+        "completion_tokens": 245,
+        "total_tokens": 284,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 4.551,
+        "content_len": 468,
+        "reasoning_len": 478,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c2_n4/server.log"
+  },
+  {
+    "label": "c4_nomtp",
+    "c": 4,
+    "n": null,
+    "mtp": false,
+    "port": 19690,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 1904,
+    "wall_sec": 21.72,
+    "api_completion_tokens_per_sec": 87.66,
+    "server": {
+      "draft_acceptance_events": 0,
+      "draft_acceptance_weighted": null,
+      "draft_accepted_tokens": null,
+      "draft_generated_tokens": null,
+      "eval_tokens": 2165,
+      "eval_ms": 63539.18,
+      "eval_tokens_per_sec": 34.073,
+      "model_loaded": true,
+      "mtp_initialized": false
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 3.704,
+        "content_len": 54,
+        "reasoning_len": 139,
+        "completion_tokens": 117,
+        "total_tokens": 143,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 8.121,
+        "content_len": 68,
+        "reasoning_len": 396,
+        "completion_tokens": 267,
+        "total_tokens": 306,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 5.175,
+        "content_len": 28,
+        "reasoning_len": 258,
+        "completion_tokens": 161,
+        "total_tokens": 191,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.864,
+        "content_len": 442,
+        "reasoning_len": 338,
+        "completion_tokens": 304,
+        "total_tokens": 344,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.059,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.891,
+        "content_len": 436,
+        "reasoning_len": 474,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.892,
+        "content_len": 204,
+        "reasoning_len": 366,
+        "completion_tokens": 228,
+        "total_tokens": 256,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.839,
+        "content_len": 159,
+        "reasoning_len": 543,
+        "completion_tokens": 384,
+        "total_tokens": 417,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c4_nomtp/server.log"
+  },
+  {
+    "label": "c4_n1",
+    "c": 4,
+    "n": 1,
+    "mtp": true,
+    "port": 19691,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 6,
+    "nonempty_any": 8,
+    "completion_tokens": 2034,
+    "wall_sec": 35.29,
+    "api_completion_tokens_per_sec": 57.636,
+    "server": {
+      "draft_acceptance_events": 8,
+      "draft_acceptance_weighted": 0.948843,
+      "draft_accepted_tokens": 779,
+      "draft_generated_tokens": 821,
+      "eval_tokens": 2295,
+      "eval_ms": 123981.9,
+      "eval_tokens_per_sec": 18.511,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 8.506,
+        "content_len": 54,
+        "reasoning_len": 139,
+        "completion_tokens": 117,
+        "total_tokens": 143,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.421,
+        "content_len": 41,
+        "reasoning_len": 253,
+        "completion_tokens": 166,
+        "total_tokens": 196,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 23.931,
+        "content_len": 244,
+        "reasoning_len": 707,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 27.384,
+        "content_len": 0,
+        "reasoning_len": 669,
+        "completion_tokens": 384,
+        "total_tokens": 423,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 27.811,
+        "content_len": 0,
+        "reasoning_len": 825,
+        "completion_tokens": 384,
+        "total_tokens": 424,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 3.087,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 12.018,
+        "content_len": 193,
+        "reasoning_len": 336,
+        "completion_tokens": 207,
+        "total_tokens": 235,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.356,
+        "content_len": 236,
+        "reasoning_len": 435,
+        "completion_tokens": 333,
+        "total_tokens": 366,
+        "finish_reason": "stop"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c4_n1/server.log"
+  },
+  {
+    "label": "c4_n2",
+    "c": 4,
+    "n": 2,
+    "mtp": true,
+    "port": 19692,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 1886,
+    "wall_sec": 27.841,
+    "api_completion_tokens_per_sec": 67.742,
+    "server": {
+      "draft_acceptance_events": 8,
+      "draft_acceptance_weighted": 0.92243,
+      "draft_accepted_tokens": 987,
+      "draft_generated_tokens": 1070,
+      "eval_tokens": 2147,
+      "eval_ms": 93427.12,
+      "eval_tokens_per_sec": 22.98,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 7.855,
+        "content_len": 84,
+        "reasoning_len": 127,
+        "completion_tokens": 127,
+        "total_tokens": 153,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 13.631,
+        "content_len": 233,
+        "reasoning_len": 416,
+        "completion_tokens": 251,
+        "total_tokens": 291,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.298,
+        "content_len": 34,
+        "reasoning_len": 226,
+        "completion_tokens": 143,
+        "total_tokens": 173,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 20.007,
+        "content_len": 56,
+        "reasoning_len": 504,
+        "completion_tokens": 327,
+        "total_tokens": 366,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 20.087,
+        "content_len": 421,
+        "reasoning_len": 434,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.473,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.913,
+        "content_len": 208,
+        "reasoning_len": 351,
+        "completion_tokens": 226,
+        "total_tokens": 254,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.687,
+        "content_len": 188,
+        "reasoning_len": 520,
+        "completion_tokens": 369,
+        "total_tokens": 402,
+        "finish_reason": "stop"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c4_n2/server.log"
+  },
+  {
+    "label": "c4_n3",
+    "c": 4,
+    "n": 3,
+    "mtp": true,
+    "port": 19693,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 8,
+    "nonempty_any": 8,
+    "completion_tokens": 1766,
+    "wall_sec": 24.685,
+    "api_completion_tokens_per_sec": 71.541,
+    "server": {
+      "draft_acceptance_events": 8,
+      "draft_acceptance_weighted": 0.90411,
+      "draft_accepted_tokens": 990,
+      "draft_generated_tokens": 1095,
+      "eval_tokens": 2027,
+      "eval_ms": 87982.95,
+      "eval_tokens_per_sec": 23.039,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 7.08,
+        "content_len": 75,
+        "reasoning_len": 127,
+        "completion_tokens": 124,
+        "total_tokens": 150,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.58,
+        "content_len": 118,
+        "reasoning_len": 322,
+        "completion_tokens": 208,
+        "total_tokens": 248,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 7.266,
+        "content_len": 47,
+        "reasoning_len": 151,
+        "completion_tokens": 108,
+        "total_tokens": 138,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 17.009,
+        "content_len": 642,
+        "reasoning_len": 306,
+        "completion_tokens": 377,
+        "total_tokens": 413,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.668,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 21.81,
+        "content_len": 55,
+        "reasoning_len": 570,
+        "completion_tokens": 371,
+        "total_tokens": 410,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 11.626,
+        "content_len": 259,
+        "reasoning_len": 333,
+        "completion_tokens": 244,
+        "total_tokens": 272,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.338,
+        "content_len": 149,
+        "reasoning_len": 373,
+        "completion_tokens": 275,
+        "total_tokens": 308,
+        "finish_reason": "stop"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c4_n3/server.log"
+  },
+  {
+    "label": "c4_n4",
+    "c": 4,
+    "n": 4,
+    "mtp": true,
+    "port": 19694,
+    "requests": 8,
+    "ok": 8,
+    "errors": 0,
+    "nonempty_content": 7,
+    "nonempty_any": 8,
+    "completion_tokens": 1966,
+    "wall_sec": 26.861,
+    "api_completion_tokens_per_sec": 73.192,
+    "server": {
+      "draft_acceptance_events": 8,
+      "draft_acceptance_weighted": 0.871302,
+      "draft_accepted_tokens": 1178,
+      "draft_generated_tokens": 1352,
+      "eval_tokens": 2227,
+      "eval_ms": 88349.36,
+      "eval_tokens_per_sec": 25.207,
+      "model_loaded": true,
+      "mtp_initialized": true
+    },
+    "responses": [
+      {
+        "ok": true,
+        "elapsed_sec": 7.413,
+        "content_len": 54,
+        "reasoning_len": 135,
+        "completion_tokens": 116,
+        "total_tokens": 142,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 14.763,
+        "content_len": 441,
+        "reasoning_len": 344,
+        "completion_tokens": 310,
+        "total_tokens": 350,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 16.151,
+        "content_len": 568,
+        "reasoning_len": 333,
+        "completion_tokens": 384,
+        "total_tokens": 420,
+        "finish_reason": "length"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.396,
+        "content_len": 44,
+        "reasoning_len": 203,
+        "completion_tokens": 137,
+        "total_tokens": 167,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 2.485,
+        "content_len": 4,
+        "reasoning_len": 77,
+        "completion_tokens": 59,
+        "total_tokens": 88,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 19.481,
+        "content_len": 83,
+        "reasoning_len": 476,
+        "completion_tokens": 329,
+        "total_tokens": 368,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 9.219,
+        "content_len": 265,
+        "reasoning_len": 365,
+        "completion_tokens": 247,
+        "total_tokens": 275,
+        "finish_reason": "stop"
+      },
+      {
+        "ok": true,
+        "elapsed_sec": 10.706,
+        "content_len": 0,
+        "reasoning_len": 747,
+        "completion_tokens": 384,
+        "total_tokens": 417,
+        "finish_reason": "length"
+      }
+    ],
+    "server_log": "/root/autodl-tmp/step37-27b-distill/runs/143_final55_true_v3_q8_mtp_full_eval_20260705/q8_mtp_acceptance_matrix/c4_n4/server.log"
+  }
+]

GGUF/Q8_0/eval/mtp/mtp_acceptance_matrix.md ADDED Viewed

	@@ -0,0 +1,19 @@

+# MTP Acceptance Matrix
+| C | N | MTP | ok/req | nonempty any/content | api tok/s | server tok/s | draft acceptance | speedup vs no MTP |
+|---:|---:|:---:|---:|---:|---:|---:|---:|---:|
+| 1 |  | off | 4/4 | 4/4 | 43.54 | 50.468 | None | None |
+| 1 | 1 | on | 4/4 | 4/3 | 56.78 | 65.497 | 0.955734 | 1.304 |
+| 1 | 2 | on | 4/4 | 4/4 | 64.726 | 76.247 | 0.923323 | 1.487 |
+| 1 | 3 | on | 4/4 | 4/3 | 63.877 | 74.431 | 0.91763 | 1.467 |
+| 1 | 4 | on | 4/4 | 4/4 | 65.492 | 76.626 | 0.876302 | 1.504 |
+| 2 |  | off | 4/4 | 4/3 | 71.55 | 44.661 | None | None |
+| 2 | 1 | on | 4/4 | 4/4 | 59.323 | 36.222 | 0.952849 | 0.829 |
+| 2 | 2 | on | 4/4 | 4/4 | 68.406 | 41.035 | 0.936134 | 0.956 |
+| 2 | 3 | on | 4/4 | 4/4 | 74.24 | 46.574 | 0.907433 | 1.038 |
+| 2 | 4 | on | 4/4 | 4/4 | 72.902 | 48.769 | 0.862644 | 1.019 |
+| 4 |  | off | 8/8 | 8/8 | 87.66 | 34.073 | None | None |
+| 4 | 1 | on | 8/8 | 8/6 | 57.636 | 18.511 | 0.948843 | 0.657 |
+| 4 | 2 | on | 8/8 | 8/8 | 67.742 | 22.98 | 0.92243 | 0.773 |
+| 4 | 3 | on | 8/8 | 8/8 | 71.541 | 23.039 | 0.90411 | 0.816 |
+| 4 | 4 | on | 8/8 | 8/7 | 73.192 | 25.207 | 0.871302 | 0.835 |