lyffseba commited on
Commit
932a799
·
verified ·
1 Parent(s): a60738d

xai portal: START_HERE.md

Browse files
Files changed (1) hide show
  1. START_HERE.md +33 -36
START_HERE.md CHANGED
@@ -1,53 +1,50 @@
1
  # START HERE
2
 
3
- Airplane mode OK. No network. No pip. Python ≥ 3.10 stdlib only.
4
 
5
- ## 60-second orientation
6
 
7
- | | |
8
- |---|---|
9
- | **Local face** | open [`index.html`](index.html) |
10
- | **This path** | markdown under `studies/` + `dissertation/` |
11
- | **Public portal** | [HF Space](https://huggingface.co/spaces/lyffseba/xai) · [static](https://lyffseba-xai.static.hf.space) |
12
- | **Full mirror** | [HF Dataset](https://huggingface.co/datasets/lyffseba/xai-studies) |
13
- | **Verify once** | `make test` or `python3 studies/run.py test` → expect `✓ test passed` |
14
-
15
- ---
16
 
17
- ## What to study
18
 
19
- | Track | Path | Why first |
20
- |---|---|---|
21
- | **Inkling** | [`studies/models/inkling/`](studies/models/inkling/) | Public weights + vendored transformers sources |
22
- | **Kimi K3** | [`studies/models/kimi-k3/`](studies/models/kimi-k3/) | Live API + KDA theory; weights pending (~July 27) |
23
- | **Compare** | [`studies/shared/comparisons/inkling-vs-kimi-k3.md`](studies/shared/comparisons/inkling-vs-kimi-k3.md) | Long-ctx / MoE / product bets |
24
- | **MSc** | [`dissertation/main.ipynb`](dissertation/main.ipynb) | Vinyl-cover genre CNN + Concept Whitening |
25
 
26
- ---
27
 
28
- ## Suggested order (~1–2 days)
29
 
30
- 1. **Map** [STUDY.md](studies/STUDY.md) · [DASHBOARD.md](studies/derived/DASHBOARD.md) · [GLOSSARY.md](studies/shared/GLOSSARY.md)
31
- 2. **Inkling deep** — book `00` → `derived/SPEC.md` → arch `01` → code-study with `reference/transformers-inkling/modular_inkling.py`
32
- 3. **Kimi K3 deep** — book `00` → `derived/SPEC.md` + `lineage.md` KDA notes + API protocol → limitations / open questions
33
- 4. **Compare** re-read comparison; answer the three questions at the bottom of [STUDY.md](studies/STUDY.md)
34
- 5. **Dissertation** [dissertation/README.md](dissertation/README.md) then run the notebook when you have data
 
35
 
36
- ---
37
 
38
- ## Facts (do not invent beyond these)
 
 
 
 
39
 
40
- - **Inkling:** ~975B / 41B active · 6/256 + 2 shared · relative PE (not RoPE) · hybrid SWA/global · image+audio · 1M ctx
41
- - **Kimi K3:** 2.8T · Stable LatentMoE 16/896 · KDA + AttnRes · vision/video · 1M ctx · active params **undisclosed** · weights ETA **2026-07-27**
42
 
43
- ---
 
44
 
45
- ## Offline vs online
46
 
47
- | Offline | Online only |
48
  |---|---|
49
- | `make test` / `python3 studies/run.py test` | `make refresh MODEL=inkling` |
50
- | `make check` (re-derive from local sources) | `make refresh MODEL=kimi-k3` |
51
- | Read all markdown + vendored `reference/` | Hub / blog re-fetch |
52
 
53
- [OFFLINE.md](OFFLINE.md) · keep GH+HF synced → `make sync` ([PUSH.md](PUSH.md)) · checklist → [CHECKLIST.md](CHECKLIST.md)
 
1
  # START HERE
2
 
3
+ **xai** = **explainable AI**. Offline. No pip. Python ≥ 3.10 stdlib.
4
 
5
+ ## open
6
 
7
+ 1. [index.html](index.html)
8
+ 2. markdown under `studies/` · `dissertation/`
9
+ 3. public portal: [spaces/lyffseba/xai](https://huggingface.co/spaces/lyffseba/xai)
 
 
 
 
 
 
10
 
11
+ ## prove it works
12
 
13
+ ```
14
+ make test
15
+ # or
16
+ python3 studies/run.py test
17
+ ```
 
18
 
19
+ → `✓ test passed` (no network).
20
 
21
+ ## study
22
 
23
+ | | path | why |
24
+ |---|---|---|
25
+ | Inkling | [studies/models/inkling/](studies/models/inkling/) | public weights + vendored transformers |
26
+ | Kimi K3 | [studies/models/kimi-k3/](studies/models/kimi-k3/) | live API + KDA; weights ~2026-07-27 |
27
+ | compare | [inkling-vs-kimi-k3](studies/shared/comparisons/inkling-vs-kimi-k3.md) | long-ctx / MoE bets |
28
+ | MSc | [dissertation/main.ipynb](dissertation/main.ipynb) | Concept Whitening |
29
 
30
+ ## order (~1–2 days)
31
 
32
+ 1. map — [STUDY.md](studies/STUDY.md) · [DASHBOARD](studies/derived/DASHBOARD.md) · [GLOSSARY](studies/shared/GLOSSARY.md)
33
+ 2. Inkling — book `00` → SPEC → arch → `modular_inkling.py`
34
+ 3. Kimi K3 — book `00` → SPEC → lineage → KDA → API → limits
35
+ 4. compare again
36
+ 5. dissertation when data is ready
37
 
38
+ ## facts (do not invent)
 
39
 
40
+ - **Inkling:** ~975B / 41B · 6/256+2 · relative PE · SWA/global · image+audio · 1M
41
+ - **Kimi K3:** 2.8T · 16/896 · KDA+AttnRes · vision/video · 1M · active undisclosed · weights ETA 2026-07-27
42
 
43
+ ## offline vs online
44
 
45
+ | offline | online |
46
  |---|---|
47
+ | `make test` / `make check` | `make refresh MODEL=` |
48
+ | read `reference/` | Hub / blog re-fetch |
 
49
 
50
+ [OFFLINE.md](OFFLINE.md) · mirrors: `make sync`