Instructions to use ryoji-info/Gemma-4-12B-PsiLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use ryoji-info/Gemma-4-12B-PsiLM with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Gemma-4-12B-PsiLM ryoji-info/Gemma-4-12B-PsiLM
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Card: what PsiLM costs and what it buys
Browse files
README.md
CHANGED
|
@@ -107,6 +107,24 @@ psi = PsiLMMLX(model, tok, fno, bridges, l_fwd=cfg["coupling"]["l_fwd"], l_rev=c
|
|
| 107 |
# psi.generate(QABuilder(hf_tokenizer), {"a": 1.28, "phi": 0.5, "x0": 0.76}) -- see psilm_infer.py
|
| 108 |
```
|
| 109 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 110 |
## Results for this backbone
|
| 111 |
|
| 112 |
Held-out evaluation, 60 questions, accuracy within ±0.05 (`results/stage2_gemma12b/final_eval.json` in the [GitHub repository](https://github.com/ryoji-info/PsiLM)):
|
|
|
|
| 107 |
# psi.generate(QABuilder(hf_tokenizer), {"a": 1.28, "phi": 0.5, "x0": 0.76}) -- see psilm_infer.py
|
| 108 |
```
|
| 109 |
|
| 110 |
+
## What it costs and what it buys
|
| 111 |
+
|
| 112 |
+
| component | parameters | on disk | trained? |
|
| 113 |
+
|---|---:|---:|---|
|
| 114 |
+
| Gemma 4 12B-it, 4-bit MLX (language tower) | 12.28B | 6.3 GB | **frozen** |
|
| 115 |
+
| PsiLM bridges, one (backbone, task) pair | **25.5M** | 102 MB | **trained** |
|
| 116 |
+
| Burgers FNO, the physics hemisphere | 0.07M | 0.55 MB | frozen, pretrained |
|
| 117 |
+
| DPOT-Tiny, 2D task only | 7.5M | 30 MB | frozen, fine-tuned |
|
| 118 |
+
|
| 119 |
+
The trained part is **0.21% of the backbone's parameters** and 1.6% of its
|
| 120 |
+
checkpoint size. The 12.28B never move.
|
| 121 |
+
|
| 122 |
+
Measured on one Apple M2 (24 GB): **+0.21% parameters and +103 MB turn 0% into
|
| 123 |
+
97% on the physics task, at 24× lower latency** (3.14 vs 77.0 seconds per
|
| 124 |
+
question, 16.9 vs 768 generated tokens), with GSM8K and MMLU unchanged — the
|
| 125 |
+
gate's σ is 0.14 on physics against 0.004–0.008 elsewhere, so the channel is
|
| 126 |
+
shut when physics is irrelevant. The backbone's 0% is its own text protocol: it spends the whole 768-token budget deriving and never commits to an answer line (forcing it to answer also gives 0%), which is where the latency gap comes from too. The per-dataset numbers are in the next section.
|
| 127 |
+
|
| 128 |
## Results for this backbone
|
| 129 |
|
| 130 |
Held-out evaluation, 60 questions, accuracy within ±0.05 (`results/stage2_gemma12b/final_eval.json` in the [GitHub repository](https://github.com/ryoji-info/PsiLM)):
|