Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -30,7 +30,26 @@ It is here because people asked for the actual artifacts behind the work, not be
|
|
| 30 |
|
| 31 |
For the associated `LK Alpha` training lane:
|
| 32 |
|
| 33 |
-
- final reported acceptance (`alpha`) was
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
## Status
|
| 36 |
|
|
@@ -40,6 +59,16 @@ This is currently best treated as **experimental**:
|
|
| 40 |
- useful for reproducing training/export experiments
|
| 41 |
- not currently the top practical mobile recommendation versus the stronger `Qwen3-0.6B` draft lane
|
| 42 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
## Included files
|
| 44 |
|
| 45 |
- `llm.mnn`
|
|
|
|
| 30 |
|
| 31 |
For the associated `LK Alpha` training lane:
|
| 32 |
|
| 33 |
+
- final reported acceptance (`alpha`) was `0.6972` on the small Qwen3.5 dataset
|
| 34 |
+
|
| 35 |
+
## Usage
|
| 36 |
+
|
| 37 |
+
This bundle is meant for **TokForge / MNN**, not standard HF Inference.
|
| 38 |
+
|
| 39 |
+
Typical TokForge recipe:
|
| 40 |
+
|
| 41 |
+
```json
|
| 42 |
+
{
|
| 43 |
+
"backend_type": "cpu",
|
| 44 |
+
"thread_num": 2,
|
| 45 |
+
"precision": "low",
|
| 46 |
+
"memory": "low",
|
| 47 |
+
"sampler_type": "greedy",
|
| 48 |
+
"speculative_type": "draftmodel",
|
| 49 |
+
"draft_predict_length": 2,
|
| 50 |
+
"draft_config_path": "/path/to/config_cpu.json"
|
| 51 |
+
}
|
| 52 |
+
```
|
| 53 |
|
| 54 |
## Status
|
| 55 |
|
|
|
|
| 59 |
- useful for reproducing training/export experiments
|
| 60 |
- not currently the top practical mobile recommendation versus the stronger `Qwen3-0.6B` draft lane
|
| 61 |
|
| 62 |
+
## Limitations and Intended Use
|
| 63 |
+
|
| 64 |
+
- This is an experimental `Qwen3.5` draft lane, not the strongest practical mobile draft we have.
|
| 65 |
+
- Cross-family drafting was generally weaker than the same-architecture `Qwen3-0.6B -> Qwen3` draft lane.
|
| 66 |
+
- Use this for reproducibility and research rather than as the default recommended draft.
|
| 67 |
+
|
| 68 |
+
## Collection
|
| 69 |
+
|
| 70 |
+
- [TokForge Mobile Draft Models](https://huggingface.co/collections/darkmaniac7/tokforge-mobile-draft-models-69c36153ea7084ce78329665)
|
| 71 |
+
|
| 72 |
## Included files
|
| 73 |
|
| 74 |
- `llm.mnn`
|