ryoji-info commited on
Commit
47e0f95
·
verified ·
1 Parent(s): 41381a0

Card: what PsiLM costs and what it buys

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -107,6 +107,24 @@ psi = PsiLMMLX(model, tok, fno, bridges, l_fwd=cfg["coupling"]["l_fwd"], l_rev=c
107
  # psi.generate(QABuilder(hf_tokenizer), {"a": 1.28, "phi": 0.5, "x0": 0.76}) -- see psilm_infer.py
108
  ```
109
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
110
  ## Results for this backbone
111
 
112
  Held-out evaluation, 60 questions, accuracy within ±0.05 (`results/stage2_gemma12b/final_eval.json` in the [GitHub repository](https://github.com/ryoji-info/PsiLM)):
 
107
  # psi.generate(QABuilder(hf_tokenizer), {"a": 1.28, "phi": 0.5, "x0": 0.76}) -- see psilm_infer.py
108
  ```
109
 
110
+ ## What it costs and what it buys
111
+
112
+ | component | parameters | on disk | trained? |
113
+ |---|---:|---:|---|
114
+ | Gemma 4 12B-it, 4-bit MLX (language tower) | 12.28B | 6.3 GB | **frozen** |
115
+ | PsiLM bridges, one (backbone, task) pair | **25.5M** | 102 MB | **trained** |
116
+ | Burgers FNO, the physics hemisphere | 0.07M | 0.55 MB | frozen, pretrained |
117
+ | DPOT-Tiny, 2D task only | 7.5M | 30 MB | frozen, fine-tuned |
118
+
119
+ The trained part is **0.21% of the backbone's parameters** and 1.6% of its
120
+ checkpoint size. The 12.28B never move.
121
+
122
+ Measured on one Apple M2 (24 GB): **+0.21% parameters and +103 MB turn 0% into
123
+ 97% on the physics task, at 24× lower latency** (3.14 vs 77.0 seconds per
124
+ question, 16.9 vs 768 generated tokens), with GSM8K and MMLU unchanged — the
125
+ gate's σ is 0.14 on physics against 0.004–0.008 elsewhere, so the channel is
126
+ shut when physics is irrelevant. The backbone's 0% is its own text protocol: it spends the whole 768-token budget deriving and never commits to an answer line (forcing it to answer also gives 0%), which is where the latency gap comes from too. The per-dataset numbers are in the next section.
127
+
128
  ## Results for this backbone
129
 
130
  Held-out evaluation, 60 questions, accuracy within ±0.05 (`results/stage2_gemma12b/final_eval.json` in the [GitHub repository](https://github.com/ryoji-info/PsiLM)):