darkmaniac7 commited on
Commit
c7e30fe
·
verified ·
1 Parent(s): f17c0c9

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +30 -1
README.md CHANGED
@@ -30,7 +30,26 @@ It is here because people asked for the actual artifacts behind the work, not be
30
 
31
  For the associated `LK Alpha` training lane:
32
 
33
- - final reported acceptance (`alpha`) was in the `0.6972` on the small Qwen3.5 dataset
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
 
35
  ## Status
36
 
@@ -40,6 +59,16 @@ This is currently best treated as **experimental**:
40
  - useful for reproducing training/export experiments
41
  - not currently the top practical mobile recommendation versus the stronger `Qwen3-0.6B` draft lane
42
 
 
 
 
 
 
 
 
 
 
 
43
  ## Included files
44
 
45
  - `llm.mnn`
 
30
 
31
  For the associated `LK Alpha` training lane:
32
 
33
+ - final reported acceptance (`alpha`) was `0.6972` on the small Qwen3.5 dataset
34
+
35
+ ## Usage
36
+
37
+ This bundle is meant for **TokForge / MNN**, not standard HF Inference.
38
+
39
+ Typical TokForge recipe:
40
+
41
+ ```json
42
+ {
43
+ "backend_type": "cpu",
44
+ "thread_num": 2,
45
+ "precision": "low",
46
+ "memory": "low",
47
+ "sampler_type": "greedy",
48
+ "speculative_type": "draftmodel",
49
+ "draft_predict_length": 2,
50
+ "draft_config_path": "/path/to/config_cpu.json"
51
+ }
52
+ ```
53
 
54
  ## Status
55
 
 
59
  - useful for reproducing training/export experiments
60
  - not currently the top practical mobile recommendation versus the stronger `Qwen3-0.6B` draft lane
61
 
62
+ ## Limitations and Intended Use
63
+
64
+ - This is an experimental `Qwen3.5` draft lane, not the strongest practical mobile draft we have.
65
+ - Cross-family drafting was generally weaker than the same-architecture `Qwen3-0.6B -> Qwen3` draft lane.
66
+ - Use this for reproducibility and research rather than as the default recommended draft.
67
+
68
+ ## Collection
69
+
70
+ - [TokForge Mobile Draft Models](https://huggingface.co/collections/darkmaniac7/tokforge-mobile-draft-models-69c36153ea7084ce78329665)
71
+
72
  ## Included files
73
 
74
  - `llm.mnn`