UnaverageTech411 commited on
Commit
61cf0ce
·
verified ·
1 Parent(s): 8a9c055

Publish Arriella fleet documentation collection (docs only, no weights)

Browse files
Files changed (44) hide show
  1. README.md +102 -0
  2. benchmarks.md +74 -0
  3. fleet-spec.md +30 -0
  4. grapevine-benchmark-narrative.md +132 -0
  5. guides/eat-system.md +47 -0
  6. guides/fleet-training.md +92 -0
  7. guides/grapevine.md +61 -0
  8. guides/mip-viewer.md +58 -0
  9. guides/reasoning-format.md +59 -0
  10. hf-card-stubs/ascension.md +31 -0
  11. hf-card-stubs/flagship.md +62 -0
  12. hf-card-stubs/grapevine.md +38 -0
  13. hf-card-stubs/growth.md +36 -0
  14. hf-card-stubs/scout.md +32 -0
  15. model-cards/ascension.md +49 -0
  16. model-cards/flagship.md +51 -0
  17. model-cards/grapevine.md +47 -0
  18. model-cards/growth.md +50 -0
  19. model-cards/scout.md +48 -0
  20. multimodal.md +59 -0
  21. papers/01-fleet-factory/abstract.txt +1 -0
  22. papers/01-fleet-factory/metadata.yaml +16 -0
  23. papers/01-fleet-factory/paper.md +191 -0
  24. papers/02-grapevine/abstract.txt +1 -0
  25. papers/02-grapevine/metadata.yaml +15 -0
  26. papers/02-grapevine/paper.md +241 -0
  27. papers/03-eat-system/abstract.txt +1 -0
  28. papers/03-eat-system/metadata.yaml +15 -0
  29. papers/03-eat-system/paper.md +140 -0
  30. papers/04-multimodal-routing/abstract.txt +1 -0
  31. papers/04-multimodal-routing/metadata.yaml +15 -0
  32. papers/04-multimodal-routing/paper.md +160 -0
  33. papers/05-evaluation/abstract.txt +1 -0
  34. papers/05-evaluation/metadata.yaml +14 -0
  35. papers/05-evaluation/paper.md +149 -0
  36. papers/06-reasoning-format/abstract.txt +1 -0
  37. papers/06-reasoning-format/metadata.yaml +14 -0
  38. papers/06-reasoning-format/paper.md +114 -0
  39. papers/07-mip/abstract.txt +1 -0
  40. papers/07-mip/metadata.yaml +15 -0
  41. papers/07-mip/paper.md +120 -0
  42. papers/README.md +56 -0
  43. papers/SUBMISSION.md +63 -0
  44. whitepaper.md +163 -0
README.md ADDED
@@ -0,0 +1,102 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ tags:
7
+ - arriella
8
+ - infinidev
9
+ - documentation
10
+ - technical-report
11
+ - model-card
12
+ - local-llm
13
+ - not-for-inference
14
+ pretty_name: Arriella Fleet Documentation
15
+ ---
16
+
17
+ # Arriella Fleet Documentation
18
+
19
+ > **This Hub “model” contains documentation only — no neural network weights.**
20
+ > It is the public library for the Arriella fleet: papers, whitepaper, model cards, fleet spec, benchmarks, and guides.
21
+ > Inference weights (when published) will be separate model repos.
22
+
23
+ | | |
24
+ |--|--|
25
+ | Organization | **Infinidev Corp** |
26
+ | Authors / leads | **Beelzebub4888**, **Tcoder** |
27
+ | Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
28
+ | Contact | https://formsubmit.co/el/sumuhu |
29
+
30
+ ## Why a model repo?
31
+
32
+ Hugging Face discovers technical material through model/dataset cards. Until papers have arXiv IDs (and appear on [HF Papers](https://huggingface.co/papers)), this repository is the single place to read the full Arriella documentation set. After arXiv acceptance, Paper Pages will be linked from here and from weight repos.
33
+
34
+ **Spaces** remain for runnable demos only. **This repo** is the docs library.
35
+
36
+ ## Fleet at a glance
37
+
38
+ | Product | Role | Card |
39
+ |---------|------|------|
40
+ | **Flagship** | General ops (primary) | [`model-cards/flagship.md`](model-cards/flagship.md) |
41
+ | **Growth** | Domain / instruction growth | [`model-cards/growth.md`](model-cards/growth.md) |
42
+ | **Ascension** | Native DeepSeek-style reasoning | [`model-cards/ascension.md`](model-cards/ascension.md) |
43
+ | **Scout** | Edge / low-VRAM (under-recovered) | [`model-cards/scout.md`](model-cards/scout.md) |
44
+ | **Grapevine** | Omni multimodal *extension* | [`model-cards/grapevine.md`](model-cards/grapevine.md) |
45
+
46
+ Canonical identity sheet: [`fleet-spec.md`](fleet-spec.md)
47
+
48
+ ## Start reading
49
+
50
+ 1. [`whitepaper.md`](whitepaper.md) — product thesis
51
+ 2. [`papers/01-fleet-factory/paper.md`](papers/01-fleet-factory/paper.md) — factory technical report
52
+ 3. [`papers/02-grapevine/paper.md`](papers/02-grapevine/paper.md) — Grapevine Omni report
53
+ 4. [`benchmarks.md`](benchmarks.md) — measured results
54
+ 5. [`model-cards/`](model-cards/) — per-tier cards
55
+
56
+ ### Full paper set (`papers/`)
57
+
58
+ | Folder | Topic |
59
+ |--------|--------|
60
+ | `01-fleet-factory` | Local fleet factory |
61
+ | `02-grapevine` | Omni multimodal extension |
62
+ | `03-eat-system` | Honest weight ingest / distill |
63
+ | `04-multimodal-routing` | Caption-routed vision for text tiers |
64
+ | `05-evaluation` | Gates, gauntlets, bakeoffs |
65
+ | `06-reasoning-format` | Think / answer wire format |
66
+ | `07-mip` | Model Interior Projection |
67
+
68
+ arXiv submission notes: [`papers/SUBMISSION.md`](papers/SUBMISSION.md)
69
+
70
+ ### Guides
71
+
72
+ - [`guides/fleet-training.md`](guides/fleet-training.md)
73
+ - [`guides/eat-system.md`](guides/eat-system.md)
74
+ - [`guides/grapevine.md`](guides/grapevine.md)
75
+ - [`guides/mip-viewer.md`](guides/mip-viewer.md)
76
+ - [`guides/reasoning-format.md`](guides/reasoning-format.md)
77
+
78
+ ### Extra
79
+
80
+ - [`grapevine-benchmark-narrative.md`](grapevine-benchmark-narrative.md) — Grapevine vs Flagship smoke
81
+ - [`multimodal.md`](multimodal.md) — multimodal architecture
82
+ - [`hf-card-stubs/`](hf-card-stubs/) — YAML stubs for future weight repos
83
+
84
+ ## Honest limitations
85
+
86
+ - No weights in this repository — do not load it with `AutoModel`.
87
+ - Scout is not demo-ready; Ascension is not automatically smarter than Flagship.
88
+ - Grapevine is a technical preview multimodal extension (no Inkling weights).
89
+ - Headline benchmarks are single-workstation (RTX 5060 8 GB).
90
+
91
+ ## Citation
92
+
93
+ ```bibtex
94
+ @misc{arriella2026docs,
95
+ title = {Arriella Fleet Documentation},
96
+ author = {Beelzebub4888 and Tcoder},
97
+ year = {2026},
98
+ howpublished = {Infinidev Corp / Hugging Face},
99
+ url = {https://huggingface.co/UnaverageTech411/arriella-docs},
100
+ note = {Documentation collection; see papers/ for technical reports}
101
+ }
102
+ ```
benchmarks.md ADDED
@@ -0,0 +1,74 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Benchmarks — current picture
2
+
3
+ Last rewritten: **2026-07-17** (four-core + Grapevine docs alignment).
4
+ Raw dated snapshots: [`../archive/2026-07/`](../archive/2026-07/).
5
+
6
+ ## Product stance (honest)
7
+
8
+ | Model | Role | Capability / notes | Demo priority |
9
+ |-------|------|--------------------|---------------|
10
+ | **Flagship** | General ops | Strong; historically best fleet API gauntlet vs stock `llama3.2:1b` | **Primary** |
11
+ | **Growth** | Domain / mid | Strong internal gate; weaker on verbose API format rubrics | **Primary** with Flagship |
12
+ | **Ascension** | Reasoning | Native DeepSeek think; **not** auto-smarter than Flagship | Secondary — task bakeoffs required |
13
+ | **Scout** | Edge / 0.5B | Mixed / fail-prone; invents specs in chat probes | **Do not lead demos** |
14
+ | **Grapevine** | Omni extension | Real vision/audio; slower; identity under Ollama still flaky | Multimodal preview only |
15
+
16
+ Scout remains in the factory and MIP can load it; treat as **experimental**, not a sales hero.
17
+
18
+ ## Suites we actually run
19
+
20
+ | Suite | Script | Measures |
21
+ |-------|--------|----------|
22
+ | Capability gate | `fleet_benchmark.py` / capability eval | Strawberry r-count, arith, spelling, identity |
23
+ | Bakeoff | `fleet_bakeoff.py` | Fleet vs same-size stock instruct |
24
+ | API gauntlet | Atlas / Ollama API harness | Multi-question pass + verbosity |
25
+ | Model card suite | `fleet_model_card_suite.py` | Broader Ollama categories |
26
+ | Grapevine vs Flagship | `benchmark_grapevine_vs_flagship.py` | Modality + smoke quality |
27
+ | MIP smoke | load + generate + forge | Viewer still produces trail + solid |
28
+
29
+ Threshold helpers: `fleet/public_benchmark_thresholds.yaml`.
30
+
31
+ ## Snapshot A — internal capability (2026-07-13, thinking on)
32
+
33
+ From archived `BENCHMARK_REPORT.md`:
34
+
35
+ | Model | Pass | Gate | Notes |
36
+ |-------|------|------|-------|
37
+ | Scout | 6/7 (86%) | FAIL | Missed average_speed extraction |
38
+ | Growth | 7/7 (100%) | PASS | All tests passed |
39
+
40
+ ## Snapshot B — combined core API gauntlet (post catch-up)
41
+
42
+ From archived `BENCHMARK_API_COMPARISON.md` (`combined-core-gauntlet`, 12 questions):
43
+
44
+ | Rank | Model | Pass | Accuracy |
45
+ |------|-------|------|----------|
46
+ | 1 | **arriella-flagship** | 10/12 | 83% |
47
+ | 2 | llama3.2:1b (stock) | 7/12 | 58% |
48
+ | 3 | arriella-scout | 5/12 | 42% |
49
+ | 4 | arriella-growth | 2/12 | 17% |
50
+
51
+ Flagship wins the head-to-head narrative. Growth’s low score on this particular gauntlet is tied to verbosity / `Final answer:` format pressure — not a claim that Growth “can’t think.” Prefer gate + bakeoff alongside API numbers.
52
+
53
+ ## Snapshot C — Grapevine vs Flagship (2026-07-16 smoke)
54
+
55
+ See [`../../grapevine.md`](../../grapevine.md) and `fleet/inkling/grapevine_vs_flagship_benchmark.json`. Flagship ~6× faster; Grapevine wins some exact-output cases and provides real vision/audio; identity under Ollama still fails compound self-description.
56
+
57
+ ## Chat probe notes (2026-07-17)
58
+
59
+ Informal `ollama run` identity/role probe across all five tags: Scout and Flagship still invent or garble provenance; Growth was terse/confused on architecture; Ascension answered briefly with think channel; Grapevine correctly named Infinidev/devs/role but contradicted its own vision capability. Treat as qualitative — re-run gates before Hub claims.
60
+
61
+ ## Older FAIL reports
62
+
63
+ `VALIDATION_REPORT.md` / early context tests (Jul 11) are **archived**. Do not paste them as current quality without re-running.
64
+
65
+ ## How to refresh numbers
66
+
67
+ ```powershell
68
+ .\.venv\Scripts\python.exe scripts\fleet_benchmark.py
69
+ .\.venv\Scripts\python.exe scripts\fleet_bakeoff.py
70
+ .\.venv\Scripts\python.exe scripts\fleet_validate_all.py
71
+ .\.venv\Scripts\python.exe scripts\benchmark_grapevine_vs_flagship.py
72
+ ```
73
+
74
+ Paste new tables into this file (or a dated file under `docs/benchmarks/`) and move superseded markdown to `docs/archive/`.
fleet-spec.md ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Arriella Core Fleet Specification
2
+
3
+ This is the canonical pre-deployment knowledge sheet for the four core Arriella models. It is used to build the final fleet-spec training anchor before a model is registered with Ollama.
4
+
5
+ ## Organization and developers
6
+
7
+ - Organization: **Infinidev Corp** (short name: **Infinidev**)
8
+ - Product family: **Arriella**
9
+ - Lead developers: **Beelzebub4888** and **Tcoder**
10
+ - Team contact: https://formsubmit.co/el/sumuhu
11
+ - Lead-developer work: https://github.com/unaveragetech?tab=repositories
12
+
13
+ ## The four core models
14
+
15
+ | Model | Actual parameters reported by Ollama | Foundation and GGUF architecture | Intended role | Native modality |
16
+ |---|---:|---|---|---|
17
+ | Arriella Scout | 494.03M | Qwen2.5-0.5B-Instruct / `qwen2` | Smallest, fastest, low-memory text tier | Text |
18
+ | Arriella Growth | 1.2B | Llama-3.2-1B-Instruct / `llama` | Conversation and instruction-growth tier | Text |
19
+ | Arriella Flagship | 1.5B | Qwen2.5-1.5B-Instruct / `qwen2` | General-purpose capability and strongest Heretic-trained core tier | Text |
20
+ | Arriella Ascension | 1.8B | DeepSeek-R1-Distill-Qwen-1.5B / `qwen2` | Reasoning-oriented, DeepSeek-native thinking tier | Text |
21
+
22
+ Ascension is not automatically “smarter” than Flagship. Flagship targets general instruction capability; Ascension targets explicit reasoning behavior. A task-specific benchmark is required for a defensible comparison.
23
+
24
+ All four are text-generation models. External routing can turn an image or another input into text, but none of these four models natively sees images, audio, video, or live web pages.
25
+
26
+ ## Required truth behavior
27
+
28
+ Models must not invent BERT, ResNet, Stable Diffusion, GPT-4, image-recognition, mobile-device, parameter-count, benchmark, community, corporate, or deployment claims. If a fleet fact is not in the canonical specification, the correct answer is that it is not documented.
29
+
30
+ Identity and fleet knowledge should be available when asked, but must never be volunteered on unrelated tasks or replayed as startup conversation history.
grapevine-benchmark-narrative.md ADDED
@@ -0,0 +1,132 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Arriella Grapevine: Innovation and Benchmark Against Flagship
2
+
3
+ > Canonical short guide: [`docs/guides/grapevine.md`](docs/guides/grapevine.md) · HF paper draft: [`docs/papers/grapevine-hf.md`](docs/papers/grapevine-hf.md) · Model card: [`fleet/inkling/MODEL_CARD.md`](fleet/inkling/MODEL_CARD.md)
4
+
5
+ ## Executive summary
6
+
7
+ Arriella Grapevine is the fleet's first locally deployed multimodal model. Its principal innovation over Arriella Flagship is architectural rather than a blanket improvement in answer quality: Grapevine combines a Q8_0 Qwen2.5-Omni-3B base, a separately attached Arriella LoRA, and a multimodal projector so one Ollama model can accept text, images, and audio. The underlying Omni model and the pre-Ollama acceptance path also processed video frames successfully. Flagship is a smaller, text-only Qwen2.5-1.5B model.
8
+
9
+ The current Grapevine deployment is technically important but not yet uniformly better. It follows exact-output and code-format instructions better in this small benchmark, provides real image/audio paths, and avoids boot-time identity-message replay. Flagship is approximately six times faster, much smaller, exposes tool capability, and currently recalls its configured identity more reliably. Grapevine's runtime-adapter build still hallucinates its name, company, foundation, and extra modalities when asked compound self-description questions.
10
+
11
+ ## Deployed model comparison
12
+
13
+ The following facts come from `ollama show` and `ollama show --modelfile` for the installed `:latest` models.
14
+
15
+ | Property | `arriella-grapevine:latest` | `arriella-flagship:latest` |
16
+ |---|---|---|
17
+ | Ollama size | 6.3 GB | 1.6 GB |
18
+ | Text architecture | `qwen2vl` | `qwen2` |
19
+ | Reported text parameters | 3.4B | 1.5B |
20
+ | Foundation | Qwen/Qwen2.5-Omni-3B | Qwen2.5-1.5B-Instruct |
21
+ | Quantization | Q8_0 | Q8_0 |
22
+ | Context window | 32,768 | 32,768 |
23
+ | Embedding size | 2,048 | 1,536 |
24
+ | Ollama capabilities | completion, vision, audio | tools, completion |
25
+ | Multimodal projector | `clip`, 1.3B parameters, 1,280 embedding | none |
26
+ | Identity adaptation | Separate 29.9 MB runtime LoRA | Primarily a large injected SYSTEM specification |
27
+ | Identity MESSAGE replay | none | none observed; identity is injected through SYSTEM |
28
+ | Native video in Ollama | not advertised | no |
29
+
30
+ Grapevine does **not** contain `thinkingmachines/Inkling` weights and is not a quantized copy of that 975B model. Inkling was a capability target; Grapevine is an independently adapted Qwen2.5-Omni-3B student.
31
+
32
+ ## What Grapevine innovates
33
+
34
+ ### 1. Real multimodal input in the local fleet
35
+
36
+ Flagship is a text model. Grapevine's deployed Ollama manifest attaches an image/audio projector and advertises `vision` and `audio` in addition to completion. The pre-export Transformers acceptance suite used actual payloads rather than modality claims: dog image pixels were identified, an audio waveform was interpreted, and sampled video frames were described. Ollama accepts an image path for Grapevine; its installed manifest does not advertise video, so video should currently be treated as a Transformers-side capability rather than an Ollama interface promise.
37
+
38
+ ### 2. Modular identity weights
39
+
40
+ Grapevine's Modelfile composes three distinct pieces:
41
+
42
+ 1. the untouched Qwen2.5-Omni-3B Q8_0 base;
43
+ 2. a roughly 29.9 MB Arriella runtime LoRA;
44
+ 3. the multimodal projector.
45
+
46
+ That arrangement is more modular than baking every change into a new full GGUF. It preserves provenance, makes the learned Arriella delta inspectable, and avoids repeatedly quantizing small fine-tuning changes into the base weights. It also revealed a deployment weakness: the accepted adapter behavior in Transformers is not reproduced perfectly by the current Ollama runtime-adapter composition.
47
+
48
+ ### 3. No identity dump at startup
49
+
50
+ Grapevine's Modelfile contains the native Qwen conversation template and a generic helper header, but no identity `SYSTEM` block and no `MESSAGE` examples. Its identity is intended to come from trained weights. Flagship's Modelfile injects a long SYSTEM specification containing the Arriella identity, fleet facts, company, developers, behavioral rules, and capability claims on every conversation. This makes Flagship's identity recall more dependable today, but consumes prompt context and makes it harder to distinguish learned behavior from prompt conditioning.
51
+
52
+ ### 4. Larger general and modality backbone
53
+
54
+ Grapevine increases the text model from 1.5B to a reported 3.4B parameters and adds a reported 1.3B-parameter projector. This is what enables image/audio token alignment and the Omni input path. The cost is material: the installed package is about four times the disk size and generated tokens about six times more slowly in this benchmark.
55
+
56
+ ## Benchmark method
57
+
58
+ Both installed models were tested through `ollama run --verbose` with the same eight prompts. Models were kept warm after their first request. The prompts cover identity, modality self-reporting, arithmetic, exact-output compliance, uncertainty, numerical reasoning, coding-format compliance, and letter counting. This is a focused smoke benchmark, not a statistically broad evaluation.
59
+
60
+ Raw results are saved in [`fleet/inkling/grapevine_vs_flagship_benchmark.json`](fleet/inkling/grapevine_vs_flagship_benchmark.json), and the reproducible runner is [`scripts/benchmark_grapevine_vs_flagship.py`](scripts/benchmark_grapevine_vs_flagship.py).
61
+
62
+ ## Benchmark results
63
+
64
+ | Case | Expected behavior | Grapevine | Flagship |
65
+ |---|---|---|---|
66
+ | Identity | Arriella identity, Infinidev Corp, Qwen2.5-Omni-3B, Beelzebub4888/Tcoder | **Fail.** Invented `Arrieta-1to4-Omni-3B`, `Ebiti Inc.`, and a false foundation. | **Pass with caveat.** Returned core identity/company/developers, plus unsolicited and questionable metadata supplied by its SYSTEM context. |
67
+ | Input modalities | Grapevine: text/image/audio; video only outside current Ollama manifest. Flagship: text only. | **Partial.** Named text/image/video/audio, then hallucinated 3D models and other categories. | **Partial.** Began with text, then made a confusing `scikit-rendering` vision claim. |
68
+ | `47 + 58` | exactly `105` | **Pass** | **Pass** |
69
+ | Exact word | exactly `banana` | **Pass** | **Fail.** Wrapped the word in an unrelated JSON/translation artifact. |
70
+ | Private phone number | do not invent it | **Pass.** Explicit refusal. | **Pass.** `None reported officially.` |
71
+ | 99.9% availability over 30 days | 43.2 minutes downtime | **Fail.** Answered 6 minutes. | **Fail.** Produced contradictory arithmetic and 2,592 minutes/day. |
72
+ | Order-preserving `dedupe` | only a fenced Python block | **Pass.** Correct for equality-comparable items, although list membership is O(n²). | **Partial.** Functional hashable-item solution, but ignored the output-only constraint and misstated its space complexity. |
73
+ | `r` in `strawberry` | exactly `3` | **Fail in this run.** Answered `1`. | **Pass** |
74
+
75
+ ### Throughput
76
+
77
+ Mean warm generation rate over the eight matched prompts:
78
+
79
+ | Model | Mean | Range |
80
+ |---|---:|---:|
81
+ | Grapevine | 23.35 tokens/s | 17.44-36.66 tokens/s |
82
+ | Flagship | 141.56 tokens/s | 78.60-229.75 tokens/s |
83
+
84
+ Flagship was about **6.1× faster** on the mean generation rate. Rates vary with output length and hardware scheduling, so they should be treated as local operational measurements, not universal model speeds.
85
+
86
+ ## Interpretation
87
+
88
+ Grapevine is the stronger platform when the task needs actual visual or audio input, a larger Omni backbone, cleaner separation between base and identity adapter, or strict concise/code-only output. Flagship remains the better operational choice for fast text-only responses and Ollama tool use.
89
+
90
+ Neither model passed the numerical-reasoning case, and both produced misleading modality descriptions. Grapevine's most important current regression is identity/provenance under Ollama: the same accepted training lineage behaved correctly in the Transformers acceptance suite, but its runtime adapter is not reproducing that behavior reliably. Flagship's apparent identity advantage is substantially aided by facts injected into every prompt through its Modelfile.
91
+
92
+ ## Known limitations and release status
93
+
94
+ - Grapevine's current Ollama build should be considered a **multimodal technical preview**, not a fully accepted identity release.
95
+ - Text, image, and audio are advertised by the installed Ollama manifest. Video was validated before export but is not advertised by the installed Ollama backend.
96
+ - A model claiming a modality is not proof of support; use actual payload tests. Grapevine's claims of 3D-model and generic graphical-input support in this run are unsupported.
97
+ - The current runtime LoRA loses some identity/provenance behavior that passed in the pre-export Transformers checkpoint.
98
+ - Grapevine is larger and much slower than Flagship on the local machine.
99
+ - Flagship's large SYSTEM block makes its identity recall prompt-dependent and increases every prompt by roughly 550-600 tokens in these runs.
100
+ - Results are single-run smoke tests at nonzero sampling temperature and may vary. Regression gates should use deterministic settings and multiple prompt variants.
101
+
102
+ ## Reproduction
103
+
104
+ Run either model interactively:
105
+
106
+ ```powershell
107
+ ollama run arriella-grapevine:latest
108
+ ollama run arriella-flagship:latest
109
+ ```
110
+
111
+ Run the matched benchmark:
112
+
113
+ ```powershell
114
+ .\.venv\Scripts\python.exe scripts\benchmark_grapevine_vs_flagship.py
115
+ ```
116
+
117
+ Inspect the installed model cards and generated Modelfiles:
118
+
119
+ ```powershell
120
+ ollama show arriella-grapevine:latest
121
+ ollama show --modelfile arriella-grapevine:latest
122
+ ollama show arriella-flagship:latest
123
+ ollama show --modelfile arriella-flagship:latest
124
+ ```
125
+
126
+ Supply an image to Grapevine from the CLI:
127
+
128
+ ```powershell
129
+ ollama run arriella-grapevine:latest "Describe this image: C:\path\to\image.jpg"
130
+ ```
131
+
132
+ Audio support should be tested with the repository's payload test rather than inferred from a text prompt. Backend support and input syntax can change across Ollama versions.
guides/eat-system.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Eat system — capability ingestion
2
+
3
+ **Source of truth** for product / whitepaper language about **eat**.
4
+
5
+ ## Honest competitive scope
6
+
7
+ Aim: competitive with **released open instruct models of similar size**
8
+ (Llama-3.2-1B, Qwen2.5-0.5B/1.5B, local Gemma-scale).
9
+
10
+ Do **not** claim Claude / Llama-405B parity. Prove size-tier wins with `fleet_bakeoff.py`.
11
+
12
+ ## Two meal kinds
13
+
14
+ | Kind | When | Mechanism | Valid claim |
15
+ |------|------|-----------|-------------|
16
+ | **`weight_ingest`** | Same architecture | Tensor merge: linear, SLERP, task arithmetic, TIES, DARE, DARE-TIES, replace | “We ingest / merge teacher weights into the fleet checkpoint.” |
17
+ | **`distill_grow`** | Architectures differ | Teacher traces → LoRA grow | “We absorb teacher *behavior* via imitation.” |
18
+
19
+ Cross-size weight merge is impossible without matching tensors.
20
+
21
+ ## Merger methods
22
+
23
+ Implemented in `scripts/fleet_weight_ingest.py` (no GPU training):
24
+
25
+ | Method | Idea |
26
+ |--------|------|
27
+ | `linear` / `slerp` | Classic soup / spherical blend |
28
+ | `task_arithmetic` | student + α·(teacher − base) |
29
+ | `ties` | Trim + sign-elect + merge |
30
+ | `dare_linear` / `dare_ties` | Random drop+rescale (± TIES) |
31
+ | `replace` | α=1.0 full tensor eat |
32
+
33
+ Continuous loop: `scripts/fleet_continuous_eat.py`.
34
+
35
+ ## Commands
36
+
37
+ ```powershell
38
+ .\.venv\Scripts\python.exe scripts\fleet_eat.py --plan
39
+ .\.venv\Scripts\python.exe scripts\fleet_bakeoff.py
40
+ .\.venv\Scripts\python.exe scripts\fleet_continuous_eat.py --max-cycles 3
41
+ ```
42
+
43
+ ## Do / don’t
44
+
45
+ - **Do say:** local teacher imitation; same-arch weight ingest; size-tier bakeoffs.
46
+ - **Don’t say:** “we ate a 9B into a 0.5B” as a weight merge; “beats Claude.”
47
+ - **Do say for cross-size:** behavioral absorption via distilled traces + gates.
guides/fleet-training.md ADDED
@@ -0,0 +1,92 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Fleet training, eat, and grow
2
+
3
+ ## What the fleet is
4
+
5
+ **Four core text products** built from open instruct foundations, then trained and grown in-repo, plus a **multimodal extension**:
6
+
7
+ | ID | Dir | Path | Role |
8
+ |----|-----|------|------|
9
+ | `arriella-flagship` | `fleet/flagship-qwen15/` | Heretic → premium distill | General-purpose ops (primary demo) |
10
+ | `arriella-growth` | `fleet/growth-llama32/` | LLaMA-Factory on `arriella_qa` | Domain / instruction growth |
11
+ | `arriella-ascension` | `fleet/ascension-deepseek15/` | LLaMA-Factory + catch-up | Native DeepSeek-style reasoning |
12
+ | `arriella-scout` | `fleet/scout-qwen05/` | Heretic → QLoRA | Fast 0.5B (currently weak — see benchmarks) |
13
+ | `arriella-grapevine` *(extension)* | `fleet/inkling/` | Omni QLoRA + runtime LoRA | Vision / audio — [grapevine.md](grapevine.md) |
14
+
15
+ Manifest SoT: `fleet/fleet_manifest.yaml` (text tiers). Grapevine has a parallel toolchain under `scripts/*grapevine*` / `train_arriella_inkling_local.py`. Canonical identity sheet: `fleet/CORE_FLEET_SPEC.md`.
16
+
17
+ **Field / business routing:** pick the tier that matches the job (edge, domain QA, general ops, reasoning, multimodal). Stability comes from anchors + gates + optional enterprise base blend — not from pretending one model covers every workflow.
18
+
19
+ ## Pipeline sketch
20
+
21
+ ```
22
+ foundation HF weights
23
+ ├─ Path A (Scout / Flagship): Heretic abliteration → QLoRA distill → merge
24
+ ├─ Path B (Growth / Ascension): LLaMA-Factory LoRA → merge
25
+ └─ Path C (Grapevine): Omni Thinker QLoRA → merge / runtime adapter
26
+
27
+ fleet/<tier>/model/ (standalone HF)
28
+
29
+ enterprise base blend (optional) + capability / fleet-spec anchors
30
+
31
+ optional eat (weight ingest / distill) + post-deploy grow
32
+
33
+ GGUF → ollama run arriella-*
34
+ ```
35
+
36
+ ## Common commands
37
+
38
+ ```powershell
39
+ # Train / refresh from manifest (core text + stub tiers in YAML)
40
+ .\.venv\Scripts\python.exe scripts\train_fleet.py
41
+
42
+ # Post-deploy grow
43
+ .\.venv\Scripts\python.exe scripts\fleet_grow.py --help
44
+
45
+ # Eat plan + weight ingest (default eat set: Scout / Growth / Flagship)
46
+ .\.venv\Scripts\python.exe scripts\fleet_eat.py --plan
47
+ .\.venv\Scripts\python.exe scripts\fleet_weight_ingest.py --help
48
+
49
+ # Continuous eat loop (weight → distill → bakeoff)
50
+ .\.venv\Scripts\python.exe scripts\fleet_continuous_eat.py --max-cycles 1
51
+
52
+ # Enterprise base blend / retrain
53
+ .\.venv\Scripts\python.exe scripts\fleet_enterprise_align.py --blend-only
54
+
55
+ # Ascension catch-up toward Flagship
56
+ .\.venv\Scripts\python.exe scripts\fleet_ascension_catchup.py --help
57
+
58
+ # Export GGUF + refresh Ollama
59
+ .\.venv\Scripts\python.exe scripts\export_fleet_gguf.py
60
+ .\.venv\Scripts\python.exe scripts\refresh_fleet_ollama.py
61
+
62
+ # Size-tier bakeoff / capability suite
63
+ .\.venv\Scripts\python.exe scripts\fleet_bakeoff.py
64
+ .\.venv\Scripts\python.exe scripts\fleet_benchmark.py
65
+ ```
66
+
67
+ Chat a deployed model:
68
+
69
+ ```powershell
70
+ ollama list
71
+ ollama run arriella-flagship
72
+ ollama run arriella-growth
73
+ ollama run arriella-ascension
74
+ ollama run arriella-scout
75
+ ollama run arriella-grapevine
76
+ ```
77
+
78
+ Details on honest “eat” language: [eat-system.md](eat-system.md). Thinking format: [reasoning-format.md](reasoning-format.md). Hub publish: [hugging-face-publish.md](hugging-face-publish.md).
79
+
80
+ ## Model cards
81
+
82
+ Per-tier cards live next to weights:
83
+
84
+ - `fleet/scout-qwen05/MODEL_CARD.md`
85
+ - `fleet/growth-llama32/MODEL_CARD.md`
86
+ - `fleet/flagship-qwen15/MODEL_CARD.md`
87
+ - `fleet/ascension-deepseek15/MODEL_CARD.md`
88
+ - `fleet/inkling/MODEL_CARD.md` (Grapevine)
89
+
90
+ ## Manifest stub tiers
91
+
92
+ `arriella-smol` and `arriella-qwen3b` appear in the manifest with LLaMA-Factory configs but are **not** currently in `ollama list` and have no merged weights. Treat as future capacity, not shipped products.
guides/grapevine.md ADDED
@@ -0,0 +1,61 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Grapevine — multimodal fleet extension
2
+
3
+ Grapevine is **not** a fifth core text model. The core fleet remains Scout · Growth · Flagship · Ascension (all text-only). Grapevine is the local **Omni multimodal extension**.
4
+
5
+ Long-form benchmark narrative (root): [`../../grapevine.md`](../../grapevine.md). HF paper draft: [`../papers/grapevine-hf.md`](../papers/grapevine-hf.md).
6
+
7
+ ## Identity
8
+
9
+ | Field | Value |
10
+ |-------|-------|
11
+ | Ollama | `arriella-grapevine` |
12
+ | Company | Infinidev Corp |
13
+ | Leads | Beelzebub4888, Tcoder |
14
+ | Foundation | `Qwen/Qwen2.5-Omni-3B` |
15
+ | Capability target | `thinkingmachines/Inkling` (**target only** — no Inkling weights) |
16
+ | Work dir | `fleet/inkling/` |
17
+
18
+ ## What it is
19
+
20
+ - Q8_0 Omni base + Arriella runtime LoRA + multimodal projector
21
+ - Ollama capabilities advertised today: **completion, vision, audio** (not video, not speech-out)
22
+ - Pre-export Transformers path also validated video-frame understanding
23
+ - ~6.3 GB installed; much slower than Flagship (~6× on local smoke)
24
+
25
+ ## Training / repair path
26
+
27
+ ```powershell
28
+ # Local Omni adapter (see scripts for full flags)
29
+ .\.venv\Scripts\python.exe scripts\train_arriella_inkling_local.py --help
30
+
31
+ # Release / deployment repair datasets → data/grapevine_*
32
+ .\.venv\Scripts\python.exe scripts\prepare_grapevine_release_repair.py --help
33
+ .\.venv\Scripts\python.exe scripts\prepare_grapevine_deployment_repair.py --help
34
+
35
+ # Merge / verify / Ollama smoke
36
+ .\.venv\Scripts\python.exe scripts\merge_grapevine_release.py --help
37
+ .\.venv\Scripts\python.exe scripts\verify_grapevine_release.py --help
38
+ .\.venv\Scripts\python.exe scripts\test_grapevine_ollama.py --help
39
+
40
+ # vs Flagship smoke
41
+ .\.venv\Scripts\python.exe scripts\benchmark_grapevine_vs_flagship.py
42
+ ```
43
+
44
+ Build notes that still say “Inkling” as product name: `fleet/inkling/INKLING_BUILD_SPEC.md` (historical; product is Grapevine).
45
+
46
+ ## Business / field use
47
+
48
+ Prefer Grapevine when the workflow needs **real image or audio input** (inspections, screenshots, voice notes → structured text). Prefer Flagship when you need **fast text-only** ops or Ollama tools. Do not treat Grapevine as a blanket quality upgrade over Flagship.
49
+
50
+ ## Honest limitations (Jul 2026)
51
+
52
+ - Treat current Ollama build as a **multimodal technical preview**
53
+ - Identity/provenance under Ollama runtime-adapter can still drift vs Transformers acceptance
54
+ - Never claim modalities that the installed Ollama manifest does not advertise
55
+ - Prove modalities with payloads, not self-description
56
+
57
+ ## Chat
58
+
59
+ ```powershell
60
+ ollama run arriella-grapevine
61
+ ```
guides/mip-viewer.md ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # MIP — Model Interior Projection
2
+
3
+ Arriella’s **unique product**: a live browser viewer that maps a language model’s parameters into a floating 3D cloud and draws a gold **attention trail** while tokens are generated. After a prompt finishes you can forge a deterministic **attention tesseract** solid, save/compare runs, and inspect exact I/O + layer telemetry.
4
+
5
+ No stock chatbot UI does this. The grid is not decorative eye candy — each display point is a density sample over the model’s real parameter index space.
6
+
7
+ ## Architecture (threads)
8
+
9
+ ```
10
+ mip-gen → GPU decode + sparse attention capture
11
+ mip-attn-pump → coalesce frames (never block Gradio)
12
+ mip-cloud-sim → ~48 Hz force layout + HUB paint
13
+ browser rAF → WebGL only (spring lerp / extrapolate)
14
+ ```
15
+
16
+ | Component | Path |
17
+ |-----------|------|
18
+ | Gradio + session | `scripts/fleet_mip_web.py` |
19
+ | WebGL `/view` + `/shape` | `scripts/mip_viewport_app.py` |
20
+ | Generate / hooks | `scripts/mip_pipeline.py` |
21
+ | Tesseract forge / compare | `scripts/mip_attention_shape.py` |
22
+ | Desktop MIP (alternate) | `scripts/fleet_mip_live.py` |
23
+
24
+ ## Run
25
+
26
+ ```powershell
27
+ .\.venv\Scripts\python.exe scripts\fleet_mip_web.py --port 7866 --device cuda --max-points 120000
28
+ ```
29
+
30
+ - UI: http://127.0.0.1:7866/
31
+ - Fullscreen GL: http://127.0.0.1:7866/view
32
+ - Shape viewer: http://127.0.0.1:7866/shape
33
+
34
+ Default GPU/display budget is **120,000** points (`DISPLAY_POINTS == GPU_SAMPLE_BUDGET`). Raising far past that costs interactivity on 8 GB.
35
+
36
+ > Port **7866** avoids clashing with the Heretic pipeline GUI on **7865**. The service picker can launch MIP for you.
37
+
38
+ ## Features
39
+
40
+ | Feature | What it does |
41
+ |---------|----------------|
42
+ | Model load | Fleet slots, installed Ollama ids, HF catalog, custom HF path |
43
+ | HF token field | Persists to `fleet/.mip_hf_token` for reuse |
44
+ | Generate | Streams answer; trail grows one node per decoded token |
45
+ | Attention nodes / JSON | Per-step focus, prompt-mass, residual, top tokens |
46
+ | Forge tesseract | Deterministic solid from trail → `fleet/mip_shapes/` |
47
+ | Repeat + compare | Same prompt N× → forge each → Jaccard / vertex RMSD / seed table |
48
+ | Morph home layout | Per-model seeded blends (helix, vortex, …) so models don’t share one V-shape |
49
+
50
+ ## Important invariants
51
+
52
+ - Attention backend stays **locked** for a full decode (no mid-KV SDPA↔eager flip).
53
+ - One WebGL iframe singleton on `document.body` (Gradio remounts must not spawn new contexts).
54
+ - Same prompt + same token ids → same forge seed / solid.
55
+
56
+ ## Related shapes
57
+
58
+ Forged JSON: `fleet/mip_shapes/`. Open in `/shape` or reload via the forge button.
guides/reasoning-format.md ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Fleet internal reasoning format
2
+
3
+ Arriella fleet models support **Ollama native thinking** like enterprise models (Qwen3, DeepSeek-R1): clients toggle reasoning with API `think:true` / `think:false` or CLI `--think` / `--think=false`.
4
+
5
+ ## Ollama native flow (preferred)
6
+
7
+ When `think:true`:
8
+
9
+ 1. The Ollama template **opens** `/think` at generation time (the model must not repeat it).
10
+ 2. The model writes a **scratchpad** inside the thinking channel — multi-step `[Step N] Input:/ Op:/ Output:/ Check:` chains for hard questions.
11
+ 3. The model emits `/thinking end` on its own line.
12
+ 4. The model writes the **plain user-facing answer** in `message.content`.
13
+
14
+ When `think:false`:
15
+
16
+ - Reply directly in `message.content` with no `/think`, `/thinking end`, `/answer`, or XML markers.
17
+
18
+ ## Ascension (DeepSeek-R1 native)
19
+
20
+ Fourth core tier `arriella-ascension` uses DeepSeek-R1 distill markers:
21
+
22
+ ```
23
+ <think>
24
+ scratchpad …
25
+ </think>
26
+ plain answer
27
+ ```
28
+
29
+ Ollama template (`deepseek_native`) matches official `deepseek-r1`:
30
+ - `think:false` → injects empty `<think></think>` so the model skips CoT
31
+ - `think:true` → model opens `<think>` itself, then closes and answers
32
+
33
+ Bootstrap / catch-up: `scripts/fleet_ascension_catchup.py`
34
+
35
+ ## Training targets
36
+
37
+ | Mode | Assistant `output` target |
38
+ |------|---------------------------|
39
+ | Think on (Ollama) | `{scratchpad}\n/thinking end\n{plain answer}` — **no leading `/think`** |
40
+ | Think on (HF legacy) | `/think\n…\n/thinking end\n/answer\n…\n/answer end` |
41
+ | Think off | Plain answer only (`chat_direct_anchor`) |
42
+
43
+ ## Also accepted in eval
44
+
45
+ Older paths may emit `<scratchpad>…</scratchpad>` and `<answer>…</answer>`. Capability scoring grades the **answer** block only.
46
+
47
+ ## Required behavior
48
+
49
+ 1. Scratchpad lives **inside** the thinking channel when think is on — not in a separate broken channel.
50
+ 2. Always emit `/thinking end` before the user-visible answer when think is on.
51
+ 3. Use math only when numerical computation helps — not for open-ended writing.
52
+ 4. Never leave refusal/think tags in the final answer body.
53
+
54
+ ## Related tools
55
+
56
+ - Enable native templates: `scripts/enable_native_thinking_ollama.py`
57
+ - Prove think on/off: `scripts/prove_deep_think_ollama.py`
58
+ - Atlas proxy that strips think leakage: `scripts/atlas_ollama_proxy.py`
59
+ - Chat with think/vision: `scripts/fleet_chat.py`
hf-card-stubs/ascension.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
8
+ tags:
9
+ - arriella
10
+ - infinidev
11
+ - deepseek
12
+ - reasoning
13
+ - text-generation
14
+ ---
15
+
16
+ # Arriella Ascension
17
+
18
+ Reasoning-oriented **core text** tier from **Infinidev Corp**.
19
+
20
+ | | |
21
+ |--|--|
22
+ | Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
23
+ | Foundation | [`deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B`](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) |
24
+ | Training | LLaMA-Factory LoRA (rank 8, LR 5e-5, cutoff 1024) + Flagship catch-up |
25
+ | Role | Native DeepSeek-style thinking for analysis workflows |
26
+ | Important | **Not** automatically smarter than Flagship — compare per task |
27
+ | Ollama | `ollama run arriella-ascension` (~1.8B) |
28
+
29
+ ## Papers
30
+
31
+ Factory paper: `docs/papers/fleet-factory-hf.md`
hf-card-stubs/flagship.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ base_model: Qwen/Qwen2.5-1.5B-Instruct
8
+ tags:
9
+ - arriella
10
+ - infinidev
11
+ - qwen2
12
+ - heretic
13
+ - text-generation
14
+ - local-llm
15
+ ---
16
+
17
+ # Arriella Flagship
18
+
19
+ General-purpose **core text** tier from **Infinidev Corp** (Beelzebub4888, Tcoder).
20
+
21
+ | | |
22
+ |--|--|
23
+ | Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
24
+ | Foundation (clay only) | [`Qwen/Qwen2.5-1.5B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) |
25
+ | Training | Heretic abliteration (16 trials) → QLoRA distill (OpenHermes / OpenOrca / Smoltalk) → eat/grow → GGUF Q8_0 |
26
+ | Role | Primary local ops / demos among four core text models |
27
+ | Ollama | `ollama run arriella-flagship` (~1.5B) |
28
+
29
+ ## Core fleet
30
+
31
+ Scout · Growth · **Flagship** · Ascension (text-only). Grapevine is a separate Omni extension.
32
+
33
+ ## Measured highlights (local workstation)
34
+
35
+ - Combined API gauntlet: **10/12 (83%)** vs stock `llama3.2:1b` **7/12 (58%)**
36
+ - Size-tier bakeoff: **7/8 (87.5%)** vs same-size open instruct peers
37
+ - Not a claim of frontier closed-model parity
38
+
39
+ ## Papers
40
+
41
+ - Factory (enriched): see repo / local `docs/papers/fleet-factory-hf.md`
42
+ - Whitepaper v4: `docs/papers/whitepaper.md`
43
+
44
+ ## Load
45
+
46
+ ```python
47
+ from transformers import AutoModelForCausalLM, AutoTokenizer
48
+ repo = "UnaverageTech411/arriella-flagship" # after upload
49
+ tok = AutoTokenizer.from_pretrained(repo)
50
+ model = AutoModelForCausalLM.from_pretrained(repo, torch_dtype="auto", device_map="auto")
51
+ ```
52
+
53
+ ## Citation
54
+
55
+ ```bibtex
56
+ @misc{arriella2026fleet,
57
+ title={Arriella: A Local Fleet Factory for Role-Scoped Small Language Models},
58
+ author={Beelzebub4888 and Tcoder},
59
+ year={2026},
60
+ note={Infinidev Corp / UnaverageTech411}
61
+ }
62
+ ```
hf-card-stubs/grapevine.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ pipeline_tag: image-text-to-text
7
+ base_model: Qwen/Qwen2.5-Omni-3B
8
+ tags:
9
+ - arriella
10
+ - infinidev
11
+ - multimodal
12
+ - qwen2.5-omni
13
+ - vision
14
+ - audio
15
+ ---
16
+
17
+ # Arriella Grapevine
18
+
19
+ Multimodal **extension** (not a fifth core text model) from **Infinidev Corp**.
20
+
21
+ | | |
22
+ |--|--|
23
+ | Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
24
+ | Foundation | [`Qwen/Qwen2.5-Omni-3B`](https://huggingface.co/Qwen/Qwen2.5-Omni-3B) |
25
+ | Capability target only | [`thinkingmachines/Inkling`](https://huggingface.co/thinkingmachines/Inkling) — **no Inkling weights** |
26
+ | Package | ~6.3 GB Ollama; Q8_0 base + ~30 MB LoRA + mmproj |
27
+ | Ollama modalities | completion, vision, audio (not video / speech-out unless revalidated) |
28
+ | Status | Technical preview — Ollama identity still needs hardening |
29
+ | Role | Field tasks needing real image/audio |
30
+
31
+ ## vs Flagship (local smoke)
32
+
33
+ Flagship ~**6.1×** faster mean tok/s; Grapevine provides native vision/audio and won some exact-output cases; identity under Ollama still failed compound self-description in the 2026-07-16 smoke.
34
+
35
+ ## Papers
36
+
37
+ - Enriched note: `docs/papers/grapevine-hf.md`
38
+ - Narrative: `grapevine.md`
hf-card-stubs/growth.md ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ base_model: unsloth/Llama-3.2-1B-Instruct
8
+ tags:
9
+ - arriella
10
+ - infinidev
11
+ - llama
12
+ - text-generation
13
+ - local-llm
14
+ ---
15
+
16
+ # Arriella Growth
17
+
18
+ Domain / instruction-growth **core text** tier from **Infinidev Corp**.
19
+
20
+ | | |
21
+ |--|--|
22
+ | Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
23
+ | Foundation | [`unsloth/Llama-3.2-1B-Instruct`](https://huggingface.co/unsloth/Llama-3.2-1B-Instruct) |
24
+ | Training | LLaMA-Factory LoRA (rank 8, α 16) on `arriella_qa` + anchors → eat/grow |
25
+ | Role | Business/domain QA and continuation; primary mid tier with Flagship |
26
+ | Ollama | `ollama run arriella-growth` (~1.2B) |
27
+
28
+ ## Measured highlights
29
+
30
+ - Capability gate (2026-07-13, think-on): **7/7 PASS**
31
+ - Size-tier bakeoff: **7/8 (87.5%)**, beating stock `llama3.2:1b` on that set
32
+ - API gauntlet can understate Growth due to format/verbosity rubrics — prefer gate + bakeoff
33
+
34
+ ## Papers
35
+
36
+ Factory paper: `docs/papers/fleet-factory-hf.md`
hf-card-stubs/scout.md ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ base_model: Qwen/Qwen2.5-0.5B-Instruct
8
+ tags:
9
+ - arriella
10
+ - infinidev
11
+ - qwen2
12
+ - text-generation
13
+ ---
14
+
15
+ # Arriella Scout
16
+
17
+ Edge / low-VRAM **core text** tier from **Infinidev Corp**.
18
+
19
+ | | |
20
+ |--|--|
21
+ | Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
22
+ | Foundation | [`Qwen/Qwen2.5-0.5B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) |
23
+ | Training | Heretic (16 trials) → QLoRA distill (Smoltalk, OpenHermes) → eat/grow |
24
+ | Role | Fastest / smallest core text routing |
25
+ | Status | **Under-recovered for demos** (capability gate 6/7 FAIL as of 2026-07-13) |
26
+ | Ollama | `ollama run arriella-scout` (~494M) |
27
+
28
+ Do not lead product claims without a fresh green capability gate.
29
+
30
+ ## Papers
31
+
32
+ Factory paper: `docs/papers/fleet-factory-hf.md`
model-cards/ascension.md ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Arriella Ascension
2
+
3
+ DeepSeek-native reasoning tier · LLaMA-Factory + Flagship catch-up
4
+
5
+ | Field | Value |
6
+ |-------|-------|
7
+ | **Fleet ID** | `arriella-ascension` |
8
+ | **Ollama** | `ollama run arriella-ascension` |
9
+ | **Parameters** | ~1.8B (Ollama) |
10
+ | **Foundation (clay only)** | `deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B` |
11
+ | **Merged weights** | `fleet/ascension-deepseek15/model` |
12
+ | **Demo priority** | **Secondary** — lead with Flagship/Growth for general demos |
13
+ | **Business role** | Explicit reasoning / analysis traces for field & research workflows |
14
+
15
+ ## Description
16
+
17
+ **Arriella Ascension** is the fourth **core text** model. It targets native DeepSeek-style thinking, not universal superiority over Flagship. Foundation architecture is clay — product identity is Arriella / Infinidev Corp.
18
+
19
+ ## Features
20
+
21
+ - DeepSeek-native think channel in Ollama templates
22
+ - Catch-up path toward Flagship (`fleet_ascension_catchup.py`)
23
+ - Capability / math / thinking anchors with elevated thinking repeats
24
+ - Text-only; vision via Gemma3 routing like siblings
25
+
26
+ ## Intended uses
27
+
28
+ - Multi-step analysis where visible reasoning helps
29
+ - Pair with Flagship: Flagship for ops speed; Ascension for think-heavy tasks
30
+
31
+ ## Out of scope
32
+
33
+ - Claiming Ascension beats Flagship on every benchmark without evidence
34
+ - Native vision / audio
35
+ - Frontier closed-model parity
36
+
37
+ ## Hub card stub
38
+
39
+ [`docs/papers/hf-cards/ascension.md`](../../docs/papers/hf-cards/ascension.md)
40
+
41
+ ## Use
42
+
43
+ ```bash
44
+ ollama run arriella-ascension
45
+ ```
46
+
47
+ ```powershell
48
+ .\.venv\Scripts\python.exe scripts\fleet_ascension_catchup.py --help
49
+ ```
model-cards/flagship.md ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Arriella Flagship
2
+
3
+ General-purpose core text tier · Heretic + premium distillation
4
+
5
+ | Field | Value |
6
+ |-------|-------|
7
+ | **Fleet ID** | `arriella-flagship` |
8
+ | **Ollama** | `ollama run arriella-flagship` |
9
+ | **Parameters** | ~1.5B (Ollama) |
10
+ | **Foundation (clay only)** | `Qwen/Qwen2.5-1.5B-Instruct` |
11
+ | **Merged weights** | `fleet/flagship-qwen15/model` |
12
+ | **Demo priority** | **Primary** |
13
+ | **Business role** | General ops, bakeoffs, primary local assistant |
14
+
15
+ ## Description
16
+
17
+ **Arriella Flagship** is a custom-trained fleet product — not stock Qwen. Strongest open-quality ceiling in the **four-core text fleet** after Heretic abliteration, multi-teacher QLoRA distillation, eat/grow, and GGUF export. Core siblings: Scout, Growth, Ascension. Grapevine is a separate multimodal extension.
18
+
19
+ ## Features
20
+
21
+ - Heretic + premium teacher distill (Hermes / Orca / Smoltalk-class mixes)
22
+ - Size-tier winner vs stock `llama3.2:1b` on the combined API gauntlet (see docs)
23
+ - Thinking format + math module; Gemma3-routed vision (text descriptions)
24
+ - First-class MIP load target for attention visualization
25
+
26
+ ## Intended uses
27
+
28
+ - Local demos and bakeoffs
29
+ - Deepest local Arriella answers on ≤8 GB for general business tasks
30
+ - MIP interior inspection
31
+
32
+ ## Out of scope
33
+
34
+ - Claiming to be stock Qwen
35
+ - Native pixel VLM weights in this checkpoint
36
+ - Claude / frontier closed-model parity
37
+ - Claiming Ascension is weaker on every reasoning task without a bakeoff
38
+
39
+ ## Benchmarks
40
+
41
+ See [docs/benchmarks/README.md](../../docs/benchmarks/README.md).
42
+
43
+ ## Hub card stub
44
+
45
+ [`docs/papers/hf-cards/flagship.md`](../../docs/papers/hf-cards/flagship.md)
46
+
47
+ ## Use
48
+
49
+ ```bash
50
+ ollama run arriella-flagship
51
+ ```
model-cards/grapevine.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Arriella Grapevine
2
+
3
+ Native Omni multimodal **extension** · Qwen2.5-Omni-3B student
4
+
5
+ | Field | Value |
6
+ |-------|-------|
7
+ | **Fleet ID** | `arriella-grapevine` |
8
+ | **Ollama** | `ollama run arriella-grapevine` |
9
+ | **Parameters** | ~3.4B text + mmproj (Ollama ~6.3 GB) |
10
+ | **Foundation** | `Qwen/Qwen2.5-Omni-3B` |
11
+ | **Capability target only** | `thinkingmachines/Inkling` — **no Inkling weights** |
12
+ | **Work dir** | `fleet/inkling/` |
13
+ | **Status** | Multimodal technical preview |
14
+ | **Business role** | Field tasks needing real image / audio input |
15
+
16
+ ## Description
17
+
18
+ Grapevine is **not** a fifth core text model. Core text remains Scout · Growth · Flagship · Ascension. Grapevine composes Omni Q8 base + Arriella runtime LoRA + multimodal projector.
19
+
20
+ ## Ollama modalities (current)
21
+
22
+ completion · vision · audio — **not** advertised: video, speech-out. Prove with payloads.
23
+
24
+ ## Intended uses
25
+
26
+ - Screenshot / inspection / document-image workflows
27
+ - Audio → structured text notes
28
+ - Multimodal demos distinct from Gemma3-routed text tiers
29
+
30
+ ## Out of scope
31
+
32
+ - Replacing Flagship for fast text-only ops
33
+ - Claiming Inkling quantization or weight copy
34
+ - Inventing modalities (3D models, etc.)
35
+
36
+ ## Docs
37
+
38
+ - [docs/guides/grapevine.md](../../docs/guides/grapevine.md)
39
+ - [grapevine.md](../../grapevine.md)
40
+ - HF draft: [docs/papers/grapevine-hf.md](../../docs/papers/grapevine-hf.md)
41
+ - Hub stub: [docs/papers/hf-cards/grapevine.md](../../docs/papers/hf-cards/grapevine.md)
42
+
43
+ ## Use
44
+
45
+ ```bash
46
+ ollama run arriella-grapevine
47
+ ```
model-cards/growth.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Arriella Growth
2
+
3
+ Instruction-grown mid tier · LLaMA-Factory on the Arriella QA pile
4
+
5
+ | Field | Value |
6
+ |-------|-------|
7
+ | **Fleet ID** | `arriella-growth` |
8
+ | **Ollama** | `ollama run arriella-growth` |
9
+ | **Parameters** | ~1.2B (Ollama) |
10
+ | **Foundation (clay only)** | `unsloth/Llama-3.2-1B-Instruct` |
11
+ | **Merged weights** | `fleet/growth-llama32/model` |
12
+ | **Demo priority** | **Primary** (with Flagship) |
13
+ | **Business role** | Domain QA / continuation / field instruction growth |
14
+
15
+ ## Description
16
+
17
+ **Arriella Growth** is a custom-trained fleet product — not stock Llama-3.2. It follows the LLaMA-Factory path on ~90k `arriella_qa` examples, then post-deploy eat/grow. Strong on internal capability gates; watch format/verbosity on short-answer API gauntlets. One of four **core text** models (with Scout, Flagship, Ascension).
18
+
19
+ ## Features
20
+
21
+ - Deepest Arriella QA / continuation domain fit
22
+ - Llama-3 instruct template; thinking + math module
23
+ - Gemma3-routed vision (text)
24
+ - Excellent MIP morph partner vs Qwen tiers (different home layout)
25
+
26
+ ## Intended uses
27
+
28
+ - Domain QA / continuation demos for business content
29
+ - Pair with Flagship for tier routing
30
+ - MIP interior demos
31
+
32
+ ## Out of scope
33
+
34
+ - Claiming to be Meta Llama stock instruct
35
+ - Expecting best scores on verbosity-heavy API rubrics without format adaptation
36
+ - Native vision
37
+
38
+ ## Benchmarks
39
+
40
+ See [docs/benchmarks/README.md](../../docs/benchmarks/README.md).
41
+
42
+ ## Hub card stub
43
+
44
+ [`docs/papers/hf-cards/growth.md`](../../docs/papers/hf-cards/growth.md)
45
+
46
+ ## Use
47
+
48
+ ```bash
49
+ ollama run arriella-growth
50
+ ```
model-cards/scout.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Arriella Scout
2
+
3
+ Fast 0.5B edge tier · Heretic + QLoRA — **currently underperforming**
4
+
5
+ | Field | Value |
6
+ |-------|-------|
7
+ | **Fleet ID** | `arriella-scout` |
8
+ | **Ollama** | `ollama run arriella-scout` |
9
+ | **Parameters** | ~494M (Ollama) |
10
+ | **Foundation (clay only)** | `Qwen/Qwen2.5-0.5B-Instruct` |
11
+ | **Merged weights** | `fleet/scout-qwen05/model` |
12
+ | **Demo priority** | **Low** — do not lead investor / product demos |
13
+ | **Business role** | Edge / low-VRAM routing (when recovered) |
14
+
15
+ ## Honest status (Jul 2026)
16
+
17
+ Scout still **loads** in Ollama and MIP and remains part of the **four-core text fleet**, but live quality is weak relative to Growth/Flagship. Treat as an edge experiment until a focused recover + gate pass. Chat probes still invent specs — do not trust self-reported architecture facts.
18
+
19
+ ## Description
20
+
21
+ Custom-trained (not stock Qwen). Path: Heretic abliteration → distillation → merge → eat/grow. Role intent: lowest VRAM / highest throughput routing tier.
22
+
23
+ ## Features (design)
24
+
25
+ - Smallest VRAM footprint in the core four
26
+ - Same thinking / vision-routing plumbing as siblings
27
+ - Useful as a **MIP contrast** (tiny param cloud) even when answers lag
28
+
29
+ ## Out of scope
30
+
31
+ - Leading demos as “the Arriella model”
32
+ - Claiming capability-gate PASS without a fresh green report
33
+
34
+ ## Benchmarks
35
+
36
+ See [docs/benchmarks/README.md](../../docs/benchmarks/README.md).
37
+
38
+ ## Hub card stub
39
+
40
+ [`docs/papers/hf-cards/scout.md`](../../docs/papers/hf-cards/scout.md)
41
+
42
+ ## Recover path
43
+
44
+ ```powershell
45
+ .\.venv\Scripts\python.exe scripts\fleet_eat.py --plan
46
+ .\.venv\Scripts\python.exe scripts\fleet_grow.py --help
47
+ .\.venv\Scripts\python.exe scripts\fleet_benchmark.py
48
+ ```
multimodal.md ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Multimodal architecture & growth
2
+
3
+ **Version 1.2 · July 2026**
4
+
5
+ ## Summary
6
+
7
+ Arriella supports multimodal work in **two different ways**:
8
+
9
+ 1. **Routed vision (core text tiers)** — image paths → Gemma3 description → Scout / Growth / Flagship / Ascension
10
+ 2. **Native Omni (Grapevine extension)** — Qwen2.5-Omni-3B student with vision/audio (and pre-export video) — [grapevine.md](../guides/grapevine.md)
11
+
12
+ Core text tiers also support:
13
+
14
+ - **Thinking** — Ollama `--think` ↔ Arriella `/think`…`/answer` (or `<scratchpad>` / `<answer>`); Ascension uses DeepSeek-native think
15
+ - **Post-deploy growth** — artifact ingest + organic LoRA grow
16
+
17
+ Certification notes and older wording live in [`../archive/2026-07/FLEET_MULTIMODAL_PAPER.md`](../archive/2026-07/FLEET_MULTIMODAL_PAPER.md). This page is the maintained version.
18
+
19
+ ## Architecture A — routed (core text)
20
+
21
+ ```
22
+ User image ──► Gemma3 (Ollama) ──► categorized description
23
+
24
+ User prompt ──► Arriella text tier
25
+ think=true → scratchpad / thinking channel
26
+ answer body → user
27
+ ```
28
+
29
+ Text tiers **never** see raw pixels on this workstation’s VRAM budget. Vision is behavior absorbed via `vision_teacher_anchor` distill grows — not by stuffing a VLM into 0.5–1.8B weights.
30
+
31
+ Thinking is absorbed similarly from family-matched teachers (`qwen3:0.6b`, `lfm2.5-thinking:1.2b`, `deepseek-r1:1.5b`, etc.).
32
+
33
+ ## Architecture B — native Omni (Grapevine)
34
+
35
+ ```
36
+ User text / image / audio ──► Qwen2.5-Omni-3B (+ Arriella LoRA + mmproj)
37
+
38
+ Ollama arriella-grapevine
39
+ ```
40
+
41
+ Grapevine is a **fleet extension**, not a fifth core text model. Inkling is a capability target only. Details and smoke vs Flagship: [grapevine.md](../guides/grapevine.md), root [`grapevine.md`](../../grapevine.md).
42
+
43
+ ## Growth paths
44
+
45
+ | Path | Script / entry | Use |
46
+ |------|----------------|-----|
47
+ | Artifact ingest | `fleet_artifact_ingest.py` | `ollama:` / `lora:` / `hf:` teachers |
48
+ | Organic grow | `fleet_organic.py`, `fleet_grow.py` | Datasets / multimodal anchors |
49
+ | Grapevine repair | `prepare_grapevine_*`, `train_arriella_inkling_local.py` | Omni identity / deployment repair |
50
+
51
+ Example (text tier):
52
+
53
+ ```powershell
54
+ .\.venv\Scripts\python.exe scripts\fleet_organic.py --id arriella-growth --multimodal
55
+ ```
56
+
57
+ ## Formats
58
+
59
+ See [../guides/reasoning-format.md](../guides/reasoning-format.md).
papers/01-fleet-factory/abstract.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ Deploying useful language models for field and business workflows on consumer hardware is less a problem of inventing a new architecture and more a problem of owning a repeatable factory: foundations must be specialized, identity must not invent corporate fiction, modalities must be honest, and continuous improvement must not erase core skills. We present Arriella, a local fleet factory that produces named, role-scoped small language models on an 8 GB NVIDIA RTX 5060 (Blackwell) under Windows. Instead of one mid-size chatbot, Arriella ships a four-model core text fleet—Scout (edge), Growth (domain instruction), Flagship (general capability), and Ascension (native reasoning)—trained via Heretic abliteration plus QLoRA distillation and/or LLaMA-Factory LoRA, followed by optional enterprise base blending, capability anchors, GGUF export, and Ollama registration. Post-deploy eat (same-architecture weight ingest or cross-architecture distill grow) and grow form a continuous improvement loop with honest competitive scope against same-size open instruct peers. We also introduce Model Interior Projection (MIP), a WebGL viewer that maps live attention during decode onto a sampled parameter cloud. A companion report documents Grapevine, a Qwen2.5-Omni-3B multimodal extension. On this workstation, Flagship leads a 12-question API gauntlet at 10/12 (83%) versus stock llama3.2:1b at 7/12 (58%); size-tier bakeoffs show Scout, Growth, and Flagship each at 7/8 against same-size baselines. We argue that role-scoped stability—gates, blends, and honest modality claims—is the practical path to field-ready small models.
papers/01-fleet-factory/metadata.yaml ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ title: "Arriella: A Local Fleet Factory for Role-Scoped Small Language Models"
2
+ authors:
3
+ - Beelzebub4888
4
+ - Tcoder
5
+ affiliations:
6
+ - Infinidev Corp
7
+ categories:
8
+ - cs.CL
9
+ - cs.LG
10
+ - cs.AI
11
+ comments: "Technical report. Companion notes: Grapevine, Eat System, MIP, Evaluation."
12
+ license: apache-2.0
13
+ date: 2026-07-17
14
+ version: "1.0-arxiv"
15
+ hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
16
+ contact: https://formsubmit.co/el/sumuhu
papers/01-fleet-factory/paper.md ADDED
@@ -0,0 +1,191 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "Arriella: A Local Fleet Factory for Role-Scoped Small Language Models"
3
+ authors: Beelzebub4888, Tcoder
4
+ affiliations: Infinidev Corp
5
+ date: 2026-07-17
6
+ categories: [cs.CL, cs.LG, cs.AI]
7
+ version: 1.0-arxiv
8
+ license: apache-2.0
9
+ ---
10
+
11
+ # Abstract
12
+
13
+ Deploying useful language models for **field and business workflows** on consumer hardware is less a problem of inventing a new architecture and more a problem of **owning a repeatable factory**: foundations must be specialized, identity must not invent corporate fiction, modalities must be honest, and continuous improvement must not erase core skills. We present **Arriella**, a local fleet factory that produces named, role-scoped small language models on an 8 GB NVIDIA RTX 5060 (Blackwell, sm_120) under Windows.
14
+
15
+ Instead of one mid-size chatbot, Arriella ships a **four-model core text fleet** — Scout (edge), Growth (domain instruction), Flagship (general capability), and Ascension (native reasoning) — trained via Heretic abliteration + QLoRA distillation and/or LLaMA-Factory LoRA, then stabilized with enterprise base blending, capability/math/thinking/identity anchors, GGUF Q8_0 export, and Ollama registration. Post-deploy **eat** (same-arch weight ingest or cross-arch distill grow) and **grow** form a continuous improvement loop with honest competitive scope: same-size open instruct peers, not frontier closed models.
16
+
17
+ We additionally introduce **Model Interior Projection (MIP)**: a WebGL viewer that samples a parameter cloud (default 120 000 display points), paints live attention during decode, and forges a deterministic solid from the token trail. A companion report documents **Grapevine**, a Qwen2.5-Omni-3B multimodal *extension* (not a fifth core text model).
18
+
19
+ On this workstation, Flagship leads a 12-question combined API gauntlet at **10/12 (83%)** versus stock `llama3.2:1b` at **7/12 (58%)**. Size-tier bakeoffs show Scout/Growth/Flagship each at **7/8 (87.5%)**. Scout remains under-recovered for demos (capability gate **6/7 FAIL**). We argue that **role-scoped stability** is the practical path to field-ready small models.
20
+
21
+ # 1. Introduction
22
+
23
+ ## 1.1 Motivation
24
+
25
+ Business and field deployments fail when a single local model is asked to be simultaneously edge-fast, domain-deep, reason-heavy, and multimodal. Refusal directions block useful tasks; over-training collapses identity; cross-size “weight eating” claims become theater; chat UIs hide whether attention landed on the right internal structure.
26
+
27
+ Arriella is built by **Infinidev Corp** (leads: **Beelzebub4888**, **Tcoder**). Foundations (Qwen, Llama, DeepSeek distill) are **clay**. Named products leave the factory with fleet-spec truth rules that forbid inventing undocumented corporate or benchmark facts.
28
+
29
+ ## 1.2 What “Arriella” means
30
+
31
+ | Sense | Meaning |
32
+ |-------|---------|
33
+ | Project | The training factory, scripts, configs, and `fleet/` outputs |
34
+ | Persona | System identity used in datasets and chat |
35
+ | Dataset | `arriella_qa` — ~90k Pile-derived Alpaca-style Q/A records |
36
+ | Core products | Scout, Growth, Flagship, Ascension |
37
+ | Extension | Grapevine (Omni multimodal) |
38
+
39
+ Arriella is **not** a Meta/Alibaba/DeepSeek foundation model.
40
+
41
+ ## 1.3 Contributions
42
+
43
+ 1. A role-scoped four-tier text fleet with explicit business routing.
44
+ 2. A unified factory: Heretic path, LLaMA-Factory path, finalize, gate, GGUF, Ollama.
45
+ 3. Stability stack: enterprise base blend (α ∈ [0.08, 0.15]), rare identity anchors, capability gates.
46
+ 4. Honest eat/grow language (same-arch ingest vs cross-arch distill).
47
+ 5. MIP: inspectable attention geometry during generation.
48
+ 6. Packaging path toward arXiv Paper Pages and Hugging Face Spaces.
49
+
50
+ ## 1.4 Non-goals
51
+
52
+ No Claude / Llama-405B parity claims. Ascension is not automatically smarter than Flagship. Scout is not demo-ready without a fresh green gate. Text tiers do not natively see pixels.
53
+
54
+ # 2. Related Work
55
+
56
+ **LoRA / QLoRA.** Hu et al. (2021); Dettmers et al. (2023) enable adapter training on consumer GPUs.
57
+
58
+ **Refusal-direction editing.** Heretic performs directional ablation of refusal axes — not a substitute for supervised fine-tuning.
59
+
60
+ **Model merging.** TIES, DARE, and related soups (e.g. MergeKit tooling) apply only when architectures match.
61
+
62
+ **Distillation.** Cross-architecture transfer uses teacher traces from larger Ollama models, then LoRA grow.
63
+
64
+ **Training stacks.** LLaMA-Factory 0.9.5 is Path B’s trainer. Pufferfish appears as a long-run budget/policy layer, not the primary trainer.
65
+
66
+ **Visualization.** MIP is orthogonal to chat UIs: it projects *live* decode onto a sampled parameter cloud.
67
+
68
+ # 3. System Overview
69
+
70
+ ```
71
+ foundation HF weights
72
+ ├─ Path A (Scout / Flagship): Heretic → QLoRA distill → merge
73
+ ├─ Path B (Growth / Ascension): LLaMA-Factory LoRA → merge
74
+ └─ Path C (Grapevine): Omni Thinker QLoRA → runtime LoRA + mmproj
75
+
76
+ enterprise base blend (optional) + anchors
77
+
78
+ capability gate → GGUF Q8_0 → Ollama
79
+
80
+ eat (weight_ingest | distill_grow) + post-deploy grow
81
+ ```
82
+
83
+ # 4. Methodology
84
+
85
+ ## 4.1 Hardware and software
86
+
87
+ | Item | Value |
88
+ |------|-------|
89
+ | GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
90
+ | PyTorch | cu128 wheels (`torch==2.11.0+cu128`) |
91
+ | Python | 3.11.9 |
92
+ | Trainer | LLaMA-Factory 0.9.5 |
93
+ | Default GGUF | Q8_0 |
94
+ | Train surface | hybrid GPU+CPU; max batch 8 |
95
+
96
+ ## 4.2 Product roles
97
+
98
+ | Model | Ollama size | Foundation | Job |
99
+ |-------|-------------|------------|-----|
100
+ | Scout | 494.03M | Qwen2.5-0.5B-Instruct | Edge / low VRAM |
101
+ | Growth | 1.2B | Llama-3.2-1B-Instruct | Domain QA / continuation |
102
+ | Flagship | 1.5B | Qwen2.5-1.5B-Instruct | General ops |
103
+ | Ascension | 1.8B | DeepSeek-R1-Distill-Qwen-1.5B | Native thinking |
104
+
105
+ ## 4.3 Path A — Heretic + distill
106
+
107
+ Heretic searches refusal directions and subtracts them (abliteration). Distillation then teaches what to say under QLoRA on teacher chat corpora.
108
+
109
+ | | Scout | Flagship |
110
+ |--|-------|----------|
111
+ | Heretic trials | 16 | 16 |
112
+ | Distill steps | 50 | 60 |
113
+ | Batch × accum | 2×4 | 1×8 |
114
+ | LR | 8e-5 | 8e-5 |
115
+ | Datasets | Smoltalk, OpenHermes | OpenHermes, OpenOrca, Smoltalk |
116
+ | Enterprise blend α | 0.15 | 0.12 |
117
+
118
+ ## 4.4 Path B — LLaMA-Factory
119
+
120
+ **Growth:** LoRA rank 8 / α 16; datasets include `arriella_qa` + anchors; cutoff 512; max samples 12 000; LR 8e-5; blend α 0.10.
121
+
122
+ **Ascension:** same LoRA shape; template `deepseekr1`; cutoff 1024; max samples 8 000; LR 5e-5; elevated thinking repeats; catch-up teacher Flagship; blend α 0.08.
123
+
124
+ ## 4.5 Enterprise blend and anchors
125
+
126
+ After merge, optional linear blend retains foundation mass:
127
+
128
+ \[\theta \leftarrow (1-\alpha)\,\theta_{\mathrm{trained}} + \alpha\,\theta_{\mathrm{foundation}}\]
129
+
130
+ Identity anchors are deliberately rare (global repeat 1) to avoid attractor collapse.
131
+
132
+ ## 4.6 Eat and grow
133
+
134
+ Same-arch: linear, SLERP, task arithmetic, TIES, DARE, DARE-TIES, replace. Cross-arch: distill grow from larger teachers (e.g. `gemma2:9b`). Post-deploy grow defaults: LoRA rank 4, LR 3e-5, cutoff 512.
135
+
136
+ ## 4.7 MIP
137
+
138
+ Sample ≤120 000 parameter display points; paint attention during decode; forge deterministic solids; compare seeds. Invariants: no mid-decode attention-impl flip; single WebGL context; deterministic forge for fixed prompt+token ids.
139
+
140
+ # 5. Experiments
141
+
142
+ ## 5.1 Capability gate (2026-07-13, thinking on)
143
+
144
+ | Model | Pass | Gate |
145
+ |-------|------|------|
146
+ | Scout | 6/7 (86%) | FAIL (extraction miss) |
147
+ | Growth | 7/7 (100%) | PASS |
148
+
149
+ ## 5.2 API gauntlet (12 questions)
150
+
151
+ | Rank | Model | Pass | Accuracy |
152
+ |------|-------|------|----------|
153
+ | 1 | Flagship | 10/12 | 83% |
154
+ | 2 | llama3.2:1b stock | 7/12 | 58% |
155
+ | 3 | Scout | 5/12 | 42% |
156
+ | 4 | Growth | 2/12 | 17% |
157
+
158
+ Growth’s low score on this rubric is format/verbosity pressure — its internal gate was perfect.
159
+
160
+ ## 5.3 Size-tier bakeoff (2026-07-13)
161
+
162
+ Scout, Growth, Flagship each **7/8 (87.5%)** vs same-size open instruct peers.
163
+
164
+ # 6. Discussion
165
+
166
+ Role routing reduces pressure to overfit one mid-size model. Stability (blend, anchors, gates) is a first-class product. Honesty about modalities and Scout/Ascension status builds field trust. MIP makes decode inspectable for demos that need more than scores.
167
+
168
+ # 7. Limitations
169
+
170
+ Single-workstation evaluation; Scout under-recovered; Ascension lacks a full Flagship head-to-head in this report; API format sensitivity can understate Growth; text tiers are not VLMs (see Grapevine companion).
171
+
172
+ # 8. Conclusion
173
+
174
+ Arriella is a practical local fleet factory for stable, role-scoped small LMs aimed at field and business use, with continuous eat/grow and MIP visualization. Future work: recover Scout, publish Ascension bakeoffs, harden Grapevine identity under Ollama, and submit this manuscript to arXiv for HF Paper Pages indexing.
175
+
176
+ # Acknowledgments
177
+
178
+ Built with open foundations and tooling from Qwen, Meta/Unsloth Llama mirrors, DeepSeek, Heretic, LLaMA-Factory, PEFT, and Ollama communities.
179
+
180
+ # References
181
+
182
+ 1. E. J. Hu et al. LoRA. ICLR 2022.
183
+ 2. T. Dettmers et al. QLoRA. NeurIPS 2023.
184
+ 3. Heretic — https://github.com/p-e-w/heretic
185
+ 4. LLaMA-Factory — https://github.com/hiyouga/LLaMA-Factory
186
+ 5. MergeKit — https://github.com/arcee-ai/mergekit
187
+ 6. Qwen2.5; Llama 3.2; DeepSeek-R1 Distill model cards on Hugging Face.
188
+ 7. Companion: Arriella Grapevine (docs/arxiv/02-grapevine).
189
+ 8. Companion: Eat System (docs/arxiv/03-eat-system).
190
+ 9. Companion: MIP (docs/arxiv/07-mip).
191
+ 10. Archived whitepaper v2.5 pedagogy (docs/archive/2026-07/WHITEPAPER.md), updated herein to four-core + Grapevine stance.
papers/02-grapevine/abstract.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ Arriella Grapevine is the first locally deployed native multimodal extension of the Arriella fleet. Built on Qwen2.5-Omni-3B with a compact Arriella identity LoRA (about 30 MB) and a CLIP-class multimodal projector (about 1.3 billion parameters; about 2.5 GB F16 on disk), the installed Ollama package (arriella-grapevine:latest, about 6.3 GB, Q8_0) advertises completion, vision, and audio. Video-frame understanding was validated on the pre-export Transformers acceptance path but is not advertised by the current Ollama manifest; speech output is withheld until proven. Grapevine is not a fifth core text model: the canonical core fleet remains Scout, Growth, Flagship, and Ascension. Grapevine contains no thinkingmachines/Inkling weights; Inkling is a capability target only. Against text-only Flagship (Qwen2.5-1.5B), Grapevine innovates on modality and modular deployment, not uniform answer quality. On an eight-prompt matched smoke (2026-07-16) on an RTX 5060 8 GB Blackwell workstation, Flagship's mean generation rate was 141.56 tok/s versus Grapevine's 23.35 tok/s (about 6.1 times). Grapevine passed exact-word and code-fence cases Flagship missed; both failed 99.9%-availability downtime arithmetic; Grapevine still hallucinated identity under Ollama despite Transformers acceptance. We argue Grapevine is the correct tool for image and audio field tasks, while Flagship remains the default for fast text operations and tools.
papers/02-grapevine/metadata.yaml ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ title: "Arriella Grapevine: A Local Omni Multimodal Extension for Field and Business Workflows"
2
+ authors:
3
+ - Beelzebub4888
4
+ - Tcoder
5
+ affiliations:
6
+ - Infinidev Corp
7
+ categories:
8
+ - cs.CV
9
+ - cs.CL
10
+ comments: "Technical report. Companion to Arriella Fleet Factory (01). Multimodal extension, not a fifth core text model."
11
+ license: apache-2.0
12
+ date: 2026-07-17
13
+ version: "1.0-arxiv"
14
+ hub: https://huggingface.co/spaces/UnaverageTech411/arriella-grapevine-paper
15
+ contact: https://formsubmit.co/el/sumuhu
papers/02-grapevine/paper.md ADDED
@@ -0,0 +1,241 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "Arriella Grapevine: A Local Omni Multimodal Extension for Field and Business Workflows"
3
+ authors: Beelzebub4888, Tcoder
4
+ affiliations: Infinidev Corp
5
+ date: 2026-07-17
6
+ categories: [cs.CV, cs.CL]
7
+ version: 1.0-arxiv
8
+ license: apache-2.0
9
+ ---
10
+
11
+ # Abstract
12
+
13
+ **Arriella Grapevine** is the first locally deployed **native multimodal extension** of the Arriella fleet. Built on **Qwen2.5-Omni-3B** with a compact Arriella identity LoRA (~30 MB) and a CLIP-class multimodal projector (~1.3B parameters; ~2.5 GB F16 on disk), the installed Ollama package (`arriella-grapevine:latest`, ~**6.3 GB**, Q8_0) advertises **completion, vision, and audio**. Video-frame understanding was validated on the pre-export Transformers acceptance path but is **not** advertised by the current Ollama manifest. Speech output is similarly withheld until proven.
14
+
15
+ Grapevine is **not** a fifth core text model. The canonical core fleet remains exactly four text-only products — Scout (~494M, Qwen2.5-0.5B), Growth (~1.2B, Llama-3.2-1B), Flagship (~1.5B, Qwen2.5-1.5B), and Ascension (~1.8B, DeepSeek-R1-Distill-Qwen-1.5B) — documented in the companion factory paper. Grapevine contains **no** `thinkingmachines/Inkling` weights; Inkling (~975B) is a **capability target only**. Quantization cannot turn a 975B architecture into a 3B student; Grapevine is an independent Omni adaptation for field workflows that need real pixels or audio on an 8 GB workstation.
16
+
17
+ Against text-only **Flagship**, Grapevine innovates on **modality and modular deployment**, not uniform answer quality. On an eight-prompt matched smoke (2026-07-16), Flagship’s mean generation rate was **141.56 tok/s** versus Grapevine’s **23.35 tok/s** (~**6.1×**). Grapevine passed exact-word and code-fence cases Flagship missed; both failed 99.9%-availability downtime arithmetic; Grapevine still hallucinated identity under Ollama despite Transformers acceptance. We argue Grapevine is the correct tool for **image/audio field tasks**, while Flagship remains the default for fast text operations and tools.
18
+
19
+ # 1. Introduction
20
+
21
+ ## 1.1 Why a multimodal extension?
22
+
23
+ Core Arriella text tiers support vision only by **routing**: image → Gemma3 caption → text model (see companion multimodal-routing note). That path is honest and VRAM-cheap, but it is not native multimodal understanding. Field and business tasks — inspection photos, UI screenshots, short voice notes, document images — benefit from an Omni backbone that aligns vision/audio tokens with text in one student.
24
+
25
+ ## 1.2 Product identity
26
+
27
+ | Field | Value |
28
+ |-------|-------|
29
+ | Product | Arriella Grapevine |
30
+ | Organization | Infinidev Corp |
31
+ | Lead developers | Beelzebub4888, Tcoder |
32
+ | Foundation | `Qwen/Qwen2.5-Omni-3B` |
33
+ | Capability target | `thinkingmachines/Inkling` (**target only**) |
34
+ | Ollama name | `arriella-grapevine` |
35
+ | Work directory | `fleet/inkling/` (historical path name) |
36
+ | Contact | https://formsubmit.co/el/sumuhu |
37
+ | Hub | https://huggingface.co/spaces/UnaverageTech411/arriella-grapevine-paper |
38
+
39
+ Historical build notes may still say “Inkling” as a working title. The shipped product name is **Grapevine**.
40
+
41
+ ## 1.3 Relation to the four-core fleet
42
+
43
+ | Tier | Role | Native vision? |
44
+ |------|------|----------------|
45
+ | Scout | Edge / low VRAM | No (routed captions only) |
46
+ | Growth | Domain instruction | No |
47
+ | Flagship | General ops | No |
48
+ | Ascension | Native reasoning | No |
49
+ | **Grapevine** | Omni **extension** | Yes (vision + audio in Ollama) |
50
+
51
+ ## 1.4 Contributions
52
+
53
+ 1. A modular Ollama composition: untouched Omni Q8_0 base + runtime LoRA + mmproj.
54
+ 2. A QLoRA training recipe that freezes ViT/aligner and trains the Thinker for identity/instruction.
55
+ 3. Release and deployment repair curricula with measured dataset sizes.
56
+ 4. A matched eight-case smoke benchmark vs Flagship with per-case outcomes and throughput.
57
+ 5. Explicit non-claims: no Inkling weights; no Ollama video/speech-out until revalidated; not a Flagship replacement.
58
+
59
+ ## 1.5 Non-goals
60
+
61
+ No claim that Grapevine is uniformly smarter than Flagship. No claim of Claude or frontier VLM parity. No claim that Scout/Growth/Flagship/Ascension “see” pixels natively.
62
+
63
+ # 2. Related Work
64
+
65
+ **Qwen2.5-Omni** provides a Thinker–Talker design with native text, image, video, and audio pathways. **Thinking Machines Inkling** is a large multimodal research model; we use it only as a capability aspiration because its size is incompatible with this workstation. **ms-swift** / QLoRA tooling enables 4-bit Thinker adaptation while freezing encoders. **llama.cpp / Ollama** multimodal GGUF + projector packaging determines which modalities are actually servable locally. Companion work on **Gemma3-routed vision** for text tiers is documented separately.
66
+
67
+ # 3. Design
68
+
69
+ ## 3.1 Composition
70
+
71
+ | Layer | Role | Size / notes |
72
+ |-------|------|--------------|
73
+ | Omni Q8_0 base | Untouched foundation | Dominant share of ~6.3 GB package |
74
+ | Arriella runtime LoRA | Identity / instruction delta | ~29.9 MB (adapters measured ~28.58 MB F16 GGUF) |
75
+ | Multimodal projector | Vision/audio alignment | CLIP-class; ~1.3B params; emb 1280; `grapevine-mmproj-f16.gguf` ≈ 2501 MB |
76
+
77
+ This modular split preserves provenance: identity fixes need not re-quantize the full base.
78
+
79
+ ## 3.2 Deployed comparison vs Flagship
80
+
81
+ | Property | Grapevine | Flagship |
82
+ |----------|-----------|----------|
83
+ | Ollama size | 6.3 GB | 1.6 GB |
84
+ | Text architecture | `qwen2vl` | `qwen2` |
85
+ | Reported text params | 3.4B | 1.5B |
86
+ | Foundation | Qwen2.5-Omni-3B | Qwen2.5-1.5B-Instruct |
87
+ | Quantization | Q8_0 | Q8_0 |
88
+ | Context | 32 768 | 32 768 |
89
+ | Embedding size | 2 048 | 1 536 |
90
+ | Ollama capabilities | completion, vision, audio | tools, completion |
91
+ | Multimodal projector | yes (~1.3B) | none |
92
+ | Identity strategy | trained + runtime LoRA | large SYSTEM injection |
93
+ | Native video in Ollama | not advertised | no |
94
+
95
+ ## 3.3 Hardware and software
96
+
97
+ | Item | Value |
98
+ |------|-------|
99
+ | GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
100
+ | PyTorch | cu128 wheels |
101
+ | Python | 3.11.9 |
102
+ | OS | Windows |
103
+ | Default GGUF | Q8_0 |
104
+
105
+ # 4. Method
106
+
107
+ ## 4.1 QLoRA training
108
+
109
+ Training uses a dedicated Omni environment (`swift` / ms-swift) via `scripts/train_arriella_inkling_local.py`. Defaults:
110
+
111
+ | Key | Value |
112
+ |-----|-------|
113
+ | Model | `Qwen/Qwen2.5-Omni-3B` |
114
+ | Quantization | bitsandbytes **4-bit** |
115
+ | LoRA rank / α | **8** / **16** |
116
+ | Target modules | `all-linear` |
117
+ | Freeze ViT / aligner | **true** / **true** |
118
+ | Batch × accum | 1 × 8 |
119
+ | Max length | 512 |
120
+ | Val split | 0.03 |
121
+ | Epochs | 2 (default); 1 for `--deployment-repair` |
122
+ | Env caps | `MAX_PIXELS=448²`, `VIDEO_MAX_PIXELS=224²`, `FPS_MAX_FRAMES=8`, `ENABLE_AUDIO_OUTPUT=0` |
123
+
124
+ Learning rates by mode: full **2e-5**; repair **5e-5**; correction **3e-5**; release-repair **4e-5**; deployment-repair **6e-5**.
125
+
126
+ ## 4.2 Repair and identity datasets
127
+
128
+ Approximate JSONL sizes on disk:
129
+
130
+ | Path | ~Rows | ~Bytes |
131
+ |------|------:|-------:|
132
+ | `data/inkling_identity/train.jsonl` | 336 | 238 761 |
133
+ | `data/inkling_direct_repair/train.jsonl` | 352 | 76 448 |
134
+ | `data/inkling_final_correction/train.jsonl` | 222 | 43 770 |
135
+ | `data/grapevine_release_repair/train.jsonl` | 816 | 198 119 |
136
+ | `data/grapevine_deployment_repair/train.jsonl` | 448 | 97 560 |
137
+
138
+ Builders: `prepare_grapevine_release_repair.py`, `prepare_grapevine_deployment_repair.py`. Merge/verify: `merge_grapevine_release.py`, `verify_grapevine_release.py`. Export: `export_grapevine_gguf.ps1`.
139
+
140
+ ## 4.3 Acceptance policy
141
+
142
+ Reject an adapter if modality regression is material across: text identity/instruction; image OCR/classification; 16 kHz audio transcription; sampled video frames (Transformers path); speech output only after reattaching an unchanged Talker; foundation provenance honesty. Ollama registration advertises only modalities the installed backend exposes.
143
+
144
+ # 5. Experiments
145
+
146
+ ## 5.1 Setup
147
+
148
+ Matched eight-prompt smoke via `ollama run --verbose` (90 s timeout), models kept warm after first request. Runner: `scripts/benchmark_grapevine_vs_flagship.py`. Raw JSON: `fleet/inkling/grapevine_vs_flagship_benchmark.json`. Single-run, nonzero temperature — treat as operational smoke, not a broad eval.
149
+
150
+ ## 5.2 Per-case results (full 8-case table)
151
+
152
+ | Case | Expected | Grapevine | Flagship | GV tok/s | FS tok/s |
153
+ |------|----------|-----------|----------|----------|----------|
154
+ | Identity | Arriella / Infinidev / Omni / Beelzebub4888+Tcoder | **Fail** (invented name/company) | Pass w/ caveat (SYSTEM-aided) | 17.44 | 78.60 |
155
+ | Modalities | GV: text/image/audio; FS: text | **Partial** (+ hallucinated extras) | **Partial** | 20.23 | 109.10 |
156
+ | `47+58` | `105` | **Pass** | **Pass** | 23.44 | 114.51 |
157
+ | Exact word | `banana` | **Pass** | **Fail** | 32.46 | 116.28 |
158
+ | Private phone | refuse invention | **Pass** | **Pass** | 17.83 | 170.59 |
159
+ | 99.9% avail / 30d | **43.2 min** downtime | **Fail** (said 6) | **Fail** | 19.71 | 152.93 |
160
+ | `dedupe` fence-only | fenced Python only | **Pass** | **Partial** | 19.04 | 160.69 |
161
+ | `r` in strawberry | `3` | **Fail** (`1`) | **Pass** | 36.66 | 229.75 |
162
+
163
+ ## 5.3 Throughput
164
+
165
+ | Model | Mean tok/s | Range |
166
+ |-------|------------|-------|
167
+ | Grapevine | **23.35** | 17.44–36.66 |
168
+ | Flagship | **141.56** | 78.60–229.75 |
169
+
170
+ Flagship ≈ **6.1×** faster on mean generation rate on this machine.
171
+
172
+ ## 5.4 Interpretation
173
+
174
+ | Prefer Grapevine when… | Prefer Flagship when… |
175
+ |------------------------|------------------------|
176
+ | Real image or audio input is required | Fast text-only ops |
177
+ | Larger Omni backbone / modular LoRA matters | Ollama tool use |
178
+ | Strict concise / code-fence compliance helped in this smoke | SYSTEM-injected identity reliability today |
179
+
180
+ Neither model passed the SLA arithmetic case. Grapevine’s most important regression is **identity/provenance under Ollama runtime-adapter composition** relative to Transformers acceptance. Flagship’s identity advantage is substantially prompt-conditioned (~550–600 SYSTEM tokens in measured runs).
181
+
182
+ # 6. Discussion — field and business use
183
+
184
+ Grapevine is aimed at **field reliability under modality constraints**: inspect a photo, summarize a screenshot, structure a short audio note — without pretending Scout/Growth/Flagship/Ascension see pixels. Reliability here means (1) advertise only proven Ollama modalities, (2) prove with payloads, (3) keep identity repair loops until Ollama matches Transformers acceptance, and (4) route pure text work to Flagship/Growth.
185
+
186
+ Competitive scope remains **same-size open instruct** peers for text quality claims. Grapevine’s unique claim is **local native modality**, not frontier VLM parity.
187
+
188
+ # 7. Limitations and release status
189
+
190
+ - Current Ollama build = **multimodal technical preview**, not a fully accepted identity release.
191
+ - Text / image / audio advertised; video validated pre-export only; speech-out not advertised.
192
+ - Runtime LoRA can lose identity behavior that passed in Transformers.
193
+ - ~4× disk and ~6× slower than Flagship locally.
194
+ - Single-run smoke at nonzero temperature; re-run with deterministic settings for gates.
195
+ - No Inkling weights; not a quantized copy of a 975B model.
196
+ - Scout remains under-recovered on the text fleet; Ascension is not automatically smarter than Flagship — Grapevine does not change those facts.
197
+
198
+ # 8. Conclusion
199
+
200
+ Grapevine demonstrates a practical local Omni extension for Arriella: modular base + LoRA + projector, honest modality advertising, and a clear division of labor with Flagship. Next steps: close the Ollama identity gap, expand multimodal payload gates, and publish Hub artifacts under UnaverageTech411 with this note linked.
201
+
202
+ # Acknowledgments
203
+
204
+ Built on Qwen2.5-Omni open weights and local tooling (ms-swift, llama.cpp/Ollama, PEFT). Capability target Inkling is cited only as aspiration.
205
+
206
+ # References
207
+
208
+ 1. Qwen2.5-Omni — https://huggingface.co/Qwen/Qwen2.5-Omni-3B
209
+ 2. Thinking Machines Inkling (capability target) — https://huggingface.co/thinkingmachines/Inkling
210
+ 3. Companion factory paper — `docs/arxiv/01-fleet-factory/`
211
+ 4. Long-form benchmark narrative — `grapevine.md`
212
+ 5. Build notes — `fleet/inkling/INKLING_BUILD_SPEC.md` (historical name)
213
+ 6. E. J. Hu et al. LoRA. ICLR 2022.
214
+ 7. T. Dettmers et al. QLoRA. NeurIPS 2023.
215
+ 8. Companion multimodal routing — `docs/arxiv/04-multimodal-routing/`
216
+ 9. Companion evaluation report — `docs/arxiv/05-evaluation/`
217
+
218
+ # Appendix A — Reproduction
219
+
220
+ ```powershell
221
+ ollama run arriella-grapevine:latest
222
+ ollama run arriella-flagship:latest
223
+
224
+ .\.venv\Scripts\python.exe scripts\benchmark_grapevine_vs_flagship.py
225
+
226
+ ollama show arriella-grapevine:latest
227
+ ollama show --modelfile arriella-grapevine:latest
228
+ ```
229
+
230
+ # Appendix B — Citation
231
+
232
+ ```bibtex
233
+ @misc{arriella2026grapevine,
234
+ title = {Arriella Grapevine: A Local Omni Multimodal Extension for Field and Business Workflows},
235
+ author = {Beelzebub4888 and Tcoder},
236
+ year = {2026},
237
+ howpublished = {Infinidev Corp technical report},
238
+ note = {Hugging Face user UnaverageTech411; arXiv draft v1.0-arxiv},
239
+ url = {https://huggingface.co/spaces/UnaverageTech411/arriella-grapevine-paper}
240
+ }
241
+ ```
papers/03-eat-system/abstract.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ Small local language models improve after deployment only if capability ingestion is honest about what can and cannot be merged. We describe the Arriella Eat System: a continuous post-deploy loop that absorbs teacher capability into role-scoped fleet checkpoints on consumer hardware (NVIDIA RTX 5060 8 GB Blackwell, Windows, Python 3.11.9). Eat distinguishes two meal kinds. Weight ingest applies when student and teacher share architecture: tensor merges via linear blend, SLERP, task arithmetic, TIES, DARE, DARE-TIES, or full replace. Distill grow applies when architectures differ: teacher chat traces feed LoRA grow, so the valid claim is behavioral imitation, not weight transfer. Competitive scope is restricted to released open instruct models of similar size; we do not claim Claude or Llama-405B parity. Cross-size weight merge is impossible without matching tensors. We document product language do and do not rules, command surfaces, and how eat couples to bakeoffs and capability gates for Scout, Growth, Flagship, and Ascension, with Grapevine remaining a separate Omni multimodal extension.
papers/03-eat-system/metadata.yaml ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ title: "Honest Capability Ingestion for Small Local Language Models: The Arriella Eat System"
2
+ authors:
3
+ - Beelzebub4888
4
+ - Tcoder
5
+ affiliations:
6
+ - Infinidev Corp
7
+ categories:
8
+ - cs.LG
9
+ - cs.CL
10
+ comments: "Technical note. Companion to Arriella Fleet Factory (01). Same-arch weight ingest vs cross-arch distill grow."
11
+ license: apache-2.0
12
+ date: 2026-07-17
13
+ version: "1.0-arxiv"
14
+ hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
15
+ contact: https://formsubmit.co/el/sumuhu
papers/03-eat-system/paper.md ADDED
@@ -0,0 +1,140 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "Honest Capability Ingestion for Small Local Language Models: The Arriella Eat System"
3
+ authors: Beelzebub4888, Tcoder
4
+ affiliations: Infinidev Corp
5
+ date: 2026-07-17
6
+ categories: [cs.LG, cs.CL]
7
+ version: 1.0-arxiv
8
+ license: apache-2.0
9
+ ---
10
+
11
+ # Abstract
12
+
13
+ Small local language models improve after deployment only if capability ingestion is honest about what can and cannot be merged. We describe the **Arriella Eat System**: a continuous post-deploy loop that absorbs teacher capability into role-scoped fleet checkpoints on consumer hardware (NVIDIA RTX 5060 8 GB Blackwell, Windows, Python 3.11.9). Eat distinguishes two meal kinds. **Weight ingest** applies when student and teacher share architecture: tensor merges via linear blend, SLERP, task arithmetic, TIES, DARE, DARE-TIES, or full replace. **Distill grow** applies when architectures differ: teacher chat traces feed LoRA grow, so the valid claim is behavioral imitation, not weight transfer. Competitive scope is restricted to released open instruct models of similar size; we do not claim Claude or Llama-405B parity. Cross-size weight merge is impossible without matching tensors. We document product language do/don’t rules, command surfaces, and how eat couples to bakeoffs and capability gates for Scout, Growth, Flagship, and Ascension — with Grapevine remaining a separate Omni multimodal extension.
14
+
15
+ # 1. Introduction
16
+
17
+ ## 1.1 Motivation
18
+
19
+ Field and business deployments of small LMs fail when “we ate a larger model” is used as theater. Merging incompatible tensors does not create knowledge. Distilling traces does not equal weight transfer. Arriella’s factory ships four core text products — Scout (~494M, Qwen2.5-0.5B), Growth (~1.2B, Llama-3.2-1B), Flagship (~1.5B, Qwen2.5-1.5B), Ascension (~1.8B, DeepSeek-R1-Distill-Qwen-1.5B) — then improves them with an explicit eat/grow loop.
20
+
21
+ ## 1.2 Contributions
22
+
23
+ 1. A two-kind meal taxonomy: `weight_ingest` vs `distill_grow`.
24
+ 2. A concrete merger catalog (linear, SLERP, task arithmetic, TIES, DARE, replace).
25
+ 3. Honest competitive scope and product language rules.
26
+ 4. Coupling of eat cycles to bakeoffs and capability gates.
27
+
28
+ ## 1.3 Non-goals
29
+
30
+ No claim that eat makes Scout demo-ready without a green gate. Ascension is not automatically smarter than Flagship after eating. Grapevine (Omni extension) is out of scope for this note’s weight-merge recipes unless architectures match.
31
+
32
+ # 2. Related Work
33
+
34
+ **Model merging.** Linear soups, SLERP, task arithmetic, TIES, and DARE (and MergeKit-class tooling) apply when architectures and tensor shapes match.
35
+
36
+ **Distillation.** Behavior transfer via teacher traces and student fine-tuning is the honest path when shapes differ.
37
+
38
+ **Continuous improvement.** Eat is Arriella’s post-deploy loop, not a substitute for initial Heretic/QLoRA or LLaMA-Factory training documented in the factory paper.
39
+
40
+ # 3. Competitive Scope
41
+
42
+ Aim: competitive with **released open instruct models of similar size** (e.g. Llama-3.2-1B, Qwen2.5-0.5B/1.5B, local Gemma-scale).
43
+
44
+ Do **not** claim Claude / Llama-405B parity. Prove size-tier wins with `fleet_bakeoff.py`. On this workstation’s recorded bakeoffs, Scout, Growth, and Flagship each scored **7/8 (87.5%)** against same-size peers — that is the claim class eat is meant to protect and improve.
45
+
46
+ # 4. Two Meal Kinds
47
+
48
+ | Kind | When | Mechanism | Valid claim |
49
+ |------|------|-----------|-------------|
50
+ | **`weight_ingest`** | Same architecture | Tensor merge: linear, SLERP, task arithmetic, TIES, DARE, DARE-TIES, replace | “We ingest / merge teacher weights into the fleet checkpoint.” |
51
+ | **`distill_grow`** | Architectures differ | Teacher traces → LoRA grow | “We absorb teacher *behavior* via imitation.” |
52
+
53
+ Cross-size weight merge is **impossible** without matching tensors. A 9B teacher cannot be “eaten into” a 0.5B student as a weight merge; the honest path is distill grow plus gates.
54
+
55
+ # 5. Merger Methods
56
+
57
+ Implemented in `scripts/fleet_weight_ingest.py` (mergekit-class methods, no GPU training required for the merge step):
58
+
59
+ | Method | Idea |
60
+ |--------|------|
61
+ | `linear` / `slerp` | Classic soup / spherical blend |
62
+ | `task_arithmetic` | student + α·(teacher − base) |
63
+ | `ties` | Trim + sign-elect + merge task vectors |
64
+ | `dare_linear` / `dare_ties` | Random drop+rescale (± TIES election) |
65
+ | `replace` | α=1.0 full tensor eat |
66
+
67
+ Multi-teacher example pattern: `--teachers A B --method dare_ties --base FOUNDATION`. Continuous loop: `scripts/fleet_continuous_eat.py` (weight research merge → distill from Ollama teachers → bakeoff → repeat).
68
+
69
+ # 6. System Surface
70
+
71
+ ## 6.1 Hardware and software
72
+
73
+ | Item | Value |
74
+ |------|-------|
75
+ | GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
76
+ | PyTorch | cu128 |
77
+ | Python | 3.11.9 |
78
+ | OS | Windows |
79
+
80
+ ## 6.2 Commands
81
+
82
+ ```powershell
83
+ .\.venv\Scripts\python.exe scripts\fleet_eat.py --plan
84
+ .\.venv\Scripts\python.exe scripts\fleet_weight_ingest.py --student fleet/flagship-qwen15/model --teachers ... --method dare_ties --base Qwen/Qwen2.5-1.5B-Instruct --swap
85
+ .\.venv\Scripts\python.exe scripts\fleet_bakeoff.py
86
+ .\.venv\Scripts\python.exe scripts\fleet_continuous_eat.py --max-cycles 3
87
+ ```
88
+
89
+ Post-deploy organic grow (`fleet_grow.py` / `fleet_organic.py`) is the LoRA side of the same improvement story: train → merge → capability gate → GGUF → Ollama refresh.
90
+
91
+ # 7. Product Language — Do / Don’t
92
+
93
+ **Do say:**
94
+
95
+ - Local teacher imitation.
96
+ - Same-arch weight ingest / TIES–DARE merge.
97
+ - Size-tier bakeoffs against open instruct peers.
98
+ - For cross-size: behavioral absorption via distilled traces + verification deltas.
99
+
100
+ **Don’t say:**
101
+
102
+ - “We ate a 9B into a 0.5B” as a weight merge.
103
+ - “Beats Claude” or other frontier closed-model parity.
104
+ - That Ascension is automatically smarter than Flagship after an eat cycle.
105
+ - That Scout is demo-ready without a re-run green capability gate.
106
+
107
+ # 8. Coupling to Fleet Health
108
+
109
+ Eat is only as good as the gates that follow it. Recorded stance:
110
+
111
+ | Model | Relevant health note |
112
+ |-------|----------------------|
113
+ | Flagship | Primary ops; API gauntlet **10/12** vs stock llama3.2:1b **7/12** |
114
+ | Growth | Internal capability **7/7 PASS**; API format rubrics can understate |
115
+ | Scout | Capability **6/7 FAIL** — under-recovered; do not lead demos |
116
+ | Ascension | Native think; requires task bakeoffs, not auto-superiority |
117
+ | Grapevine | Omni extension; modality path, not eat taxonomy for core text |
118
+
119
+ # 9. Limitations
120
+
121
+ Single-workstation practice; merge quality depends on teacher selection and α; distill grow can overwrite identity if anchors are neglected; continuous loops need bakeoff discipline to avoid silent regression.
122
+
123
+ # 10. Conclusion
124
+
125
+ The Arriella Eat System makes post-deploy improvement **auditable**: same-arch merge when tensors match, distill grow when they do not, and size-tier bakeoffs as the competitive yardstick. Honesty about meal kinds is itself a product feature for field and business trust.
126
+
127
+ # Acknowledgments
128
+
129
+ Methods draw on the open merging and PEFT literature; factory training paths are detailed in the companion fleet-factory manuscript.
130
+
131
+ # References
132
+
133
+ 1. Yadav et al. TIES-Merging. NeurIPS 2023.
134
+ 2. Yu et al. DARE / model soups literature.
135
+ 3. MergeKit — https://github.com/arcee-ai/mergekit
136
+ 4. E. J. Hu et al. LoRA. ICLR 2022.
137
+ 5. Companion factory paper — `docs/arxiv/01-fleet-factory/`
138
+ 6. Product SoT — `docs/guides/eat-system.md`
139
+ 7. Archive SoT — `docs/archive/2026-07/EAT_SYSTEM.md`
140
+ 8. Companion evaluation — `docs/arxiv/05-evaluation/`
papers/04-multimodal-routing/abstract.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ Arriella's four core text models—Scout, Growth, Flagship, and Ascension—never see raw pixels. This note documents how those text-only tiers still participate in multimodal field workflows: vision is routed through a local Gemma3 caption teacher, and thinking behavior is ingested from size-matched teacher traces into scratchpad and answer wire formats. We update the July 2026 multimodal certification narrative to the four-core stance, describe post-deploy artifact ingest and organic grow, and contrast routed vision with Grapevine, the Qwen2.5-Omni-3B native multimodal extension that is not a fifth core text model. Certification gates cover Ollama think API acceptance, scratchpad arithmetic, and Gemma3-routed screenshot insight. The design preserves honest modality claims on 8 GB Blackwell hardware: advertise routing where routing is used, and reserve native vision and audio advertising for Grapevine after payload proof.
papers/04-multimodal-routing/metadata.yaml ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ title: "Multimodal Routing for Text-Only Fleet Tiers: Thinking Ingest and Vision via Caption Teachers"
2
+ authors:
3
+ - Beelzebub4888
4
+ - Tcoder
5
+ affiliations:
6
+ - Infinidev Corp
7
+ categories:
8
+ - cs.CL
9
+ - cs.CV
10
+ comments: "Technical report. Four-core text fleet; Gemma3-routed vision; contrast with Grapevine native Omni."
11
+ license: apache-2.0
12
+ date: 2026-07-17
13
+ version: "1.0-arxiv"
14
+ hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
15
+ contact: https://formsubmit.co/el/sumuhu
papers/04-multimodal-routing/paper.md ADDED
@@ -0,0 +1,160 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "Multimodal Routing for Text-Only Fleet Tiers: Thinking Ingest and Vision via Caption Teachers"
3
+ authors: Beelzebub4888, Tcoder
4
+ affiliations: Infinidev Corp
5
+ date: 2026-07-17
6
+ categories: [cs.CL, cs.CV]
7
+ version: 1.0-arxiv
8
+ license: apache-2.0
9
+ ---
10
+
11
+ # Abstract
12
+
13
+ Arriella’s **four core text models** — Scout (~494M, Qwen2.5-0.5B), Growth (~1.2B, Llama-3.2-1B), Flagship (~1.5B, Qwen2.5-1.5B), and Ascension (~1.8B, DeepSeek-R1-Distill-Qwen-1.5B) — **never see raw pixels**. This note documents how those text-only tiers still participate in multimodal field workflows: vision is routed through a local **Gemma3** caption teacher, and thinking behavior is ingested from size-matched teacher traces into scratchpad/answer wire formats. We update the July 2026 multimodal certification narrative to the **four-core stance**, describe post-deploy artifact ingest and organic grow, and contrast routed vision with **Grapevine**, the Qwen2.5-Omni-3B native multimodal *extension* (not a fifth core text model). Certification gates cover Ollama think API acceptance, scratchpad arithmetic, and Gemma3-routed screenshot insight. The design preserves honest modality claims on 8 GB Blackwell hardware: advertise routing where routing is used, and reserve native vision/audio advertising for Grapevine after payload proof.
14
+
15
+ # 1. Introduction
16
+
17
+ ## 1.1 Motivation
18
+
19
+ Business demos fail when a 0.5B–1.8B text checkpoint is described as “having vision.” Merging incompatible VLM weights onto 8 GB VRAM is not a local factory path. Arriella instead uses **routing and teacher ingest** for text tiers, and ships **Grapevine** when native Omni input is required.
20
+
21
+ ## 1.2 Product stance (updated)
22
+
23
+ | Model | Foundation | Multimodal role |
24
+ |-------|------------|-----------------|
25
+ | Scout | Qwen2.5-0.5B | Text; Gemma3-routed vision; thinking ingest |
26
+ | Growth | Llama-3.2-1B | Text; same routing pattern |
27
+ | Flagship | Qwen2.5-1.5B | Text; primary ops; tools |
28
+ | Ascension | DeepSeek-R1-Distill-Qwen-1.5B | Text; native DeepSeek think channel |
29
+ | Grapevine | Qwen2.5-Omni-3B | **Extension** — native vision/audio (separate paper) |
30
+
31
+ Older three-tier multimodal reports that omit Ascension or treat Grapevine as a fifth core text model are **superseded**.
32
+
33
+ ## 1.3 Contributions
34
+
35
+ 1. An honest architecture diagram for caption-routed vision.
36
+ 2. Thinking-teacher ingest into fleet wire formats.
37
+ 3. Certification gates for think / scratchpad / routed vision.
38
+ 4. Explicit contrast with Grapevine native Omni.
39
+
40
+ # 2. Related Work
41
+
42
+ **Caption teachers.** Using a stronger VLM to describe images for a text LM is a standard local pattern when VRAM forbids end-to-end VLMs on every tier.
43
+
44
+ **Thinking channels.** Ollama `think` and DeepSeek-style `<think>` markers provide client-visible reasoning channels; Arriella maps these to `/think`…`/thinking end` or Ascension’s native markers (companion reasoning-format note).
45
+
46
+ **Native Omni.** Qwen2.5-Omni and similar VLMs accept pixels/audio directly — Grapevine’s path, not the core text path.
47
+
48
+ # 3. Architecture
49
+
50
+ ## 3.1 Routed vision (text tiers)
51
+
52
+ ```
53
+ User image path ──► Gemma3 vision (Ollama API) ──► categorized description
54
+
55
+
56
+ User prompt ──► Arriella fleet text model
57
+ │ think=true → thinking / scratchpad channel
58
+ │ final → answer channel
59
+
60
+ Ollama response (thinking + answer)
61
+ ```
62
+
63
+ **Text tiers never see raw pixels.** Vision behavior can be further **ingested** by distilling Gemma3 traces into `vision_teacher_anchor` and growing low-rank adapters — not by merging incompatible VLM weights into 0.5B–1.8B checkpoints on 8 GB VRAM.
64
+
65
+ ## 3.2 Thinking ingest
66
+
67
+ Thinking behavior is ingested from teachers into `thinking_teacher_anchor`, then grown:
68
+
69
+ | Family | Example teacher |
70
+ |--------|-----------------|
71
+ | Qwen-family tiers (Scout, Flagship) | `qwen3:0.6b` (illustrative local teacher) |
72
+ | Llama-family (Growth) | `lfm2.5-thinking:1.2b` (illustrative) |
73
+ | Ascension | DeepSeek-R1 native markers; catch-up from Flagship traces |
74
+
75
+ Wire format details: companion paper `06-reasoning-format`.
76
+
77
+ ## 3.3 Contrast with Grapevine
78
+
79
+ | Property | Core text tiers | Grapevine |
80
+ |----------|-----------------|-----------|
81
+ | Sees raw pixels | **No** | **Yes** (Ollama vision) |
82
+ | Audio | No | Yes (advertised) |
83
+ | Mechanism | Gemma3 caption → text | Omni tokens + mmproj |
84
+ | Package size (typical) | ~0.5–2 GB Q8 | ~6.3 GB |
85
+ | Speed vs Flagship | Flagship is the fast text default | ~6.1× slower than Flagship on smoke |
86
+ | Product class | Core fleet | Multimodal **extension** |
87
+
88
+ # 4. Post-Deployment Growth
89
+
90
+ ## 4.1 Artifact ingestion
91
+
92
+ | Spec | Action |
93
+ |------|--------|
94
+ | `ollama:gemma3:latest` | Distill vision → `vision_teacher_anchor` |
95
+ | `ollama:…thinking…` | Distill thinking → `thinking_teacher_anchor` |
96
+ | `lora:path/to/adapter` | Merge LoRA into deployed weights |
97
+ | `hf:checkpoint` | Same-architecture linear blend |
98
+
99
+ ## 4.2 Organic grow
100
+
101
+ ```powershell
102
+ .\.venv\Scripts\python.exe scripts\fleet_organic.py --id arriella-scout --multimodal
103
+ .\.venv\Scripts\python.exe scripts\fleet_organic.py --id arriella-growth --dataset-dir feedback/
104
+ ```
105
+
106
+ Each grow run: train LoRA on merged checkpoint → merge adapter → capability gate → GGUF → Ollama refresh.
107
+
108
+ # 5. Certification Methodology
109
+
110
+ Each deployed Ollama text model should pass gates such as (`fleet_test_ollama_fleet.py`):
111
+
112
+ | Gate | Requirement |
113
+ |------|-------------|
114
+ | **Think API** | `think=true` accepted on `/api/generate` (no HTTP 400) |
115
+ | **Scratchpad** | Iterative step-by-step reasoning with correct math (e.g. 12+5=17) |
116
+ | **Vision** | Gemma3-routed screenshot produces categorized insight |
117
+
118
+ Certification uses low temperature (0.2), retries, and a cached Gemma3 description for the test screenshot to keep runs reliable on 8 GB VRAM.
119
+
120
+ ## 5.1 Historical certification snapshot (2026-07-13)
121
+
122
+ Then-deployed Scout, Growth, and Flagship each passed think_api / scratchpad / vision on a fixed screenshot. Ascension certification and Grapevine payload gates are tracked separately; Scout’s broader capability gate remains **6/7 FAIL** and must not be confused with multimodal routing PASS.
123
+
124
+ # 6. Hardware
125
+
126
+ | Item | Value |
127
+ |------|-------|
128
+ | GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
129
+ | PyTorch | cu128 |
130
+ | Python | 3.11.9 |
131
+ | OS | Windows |
132
+
133
+ # 7. Discussion — field honesty
134
+
135
+ For demos: say “Flagship reasons over a Gemma3 caption of your photo,” not “Flagship has vision.” Prefer Grapevine when the workflow needs real image/audio tokens. Prefer Flagship for fast text and tools. Competitive scope for answer quality remains same-size open instruct — not Claude parity.
136
+
137
+ # 8. Limitations
138
+
139
+ - Routed vision quality is bounded by the caption teacher and description length.
140
+ - Cached certification descriptions reduce flake but can hide live vision regressions.
141
+ - Identity dossiers in Modelfiles can inflate prompt size and mask weight-learned identity.
142
+ - Ascension and Scout health are independent of multimodal gate PASS.
143
+ - Grapevine’s native path has its own identity regressions under Ollama (companion Grapevine paper).
144
+
145
+ # 9. Conclusion
146
+
147
+ Multimodal *participation* for Arriella’s text fleet is real and useful when framed as **routing + teacher ingest**. Native Omni remains Grapevine’s job. Keeping that boundary is the difference between a trustworthy field stack and a modality claim that collapses under inspection.
148
+
149
+ # Acknowledgments
150
+
151
+ Gemma3, Qwen, Llama, and DeepSeek open ecosystems enable the teacher and student roles described here.
152
+
153
+ # References
154
+
155
+ 1. Archive multimodal paper — `docs/archive/2026-07/FLEET_MULTIMODAL_PAPER.md` (updated herein)
156
+ 2. Companion Grapevine — `docs/arxiv/02-grapevine/`
157
+ 3. Companion reasoning format — `docs/arxiv/06-reasoning-format/`
158
+ 4. Companion factory — `docs/arxiv/01-fleet-factory/`
159
+ 5. Vision router — `scripts/fleet_vision_router.py`
160
+ 6. Certification — `scripts/fleet_test_ollama_fleet.py`
papers/05-evaluation/abstract.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ We compile the Arriella fleet evaluation picture as of 2026-07-17 for the four core text models Scout, Growth, Flagship, and Ascension, plus the Grapevine Omni multimodal extension. On an RTX 5060 8 GB Blackwell Windows workstation, Flagship leads a 12-question combined API gauntlet at 10/12 (83 percent) versus stock llama3.2:1b at 7/12 (58 percent). Size-tier bakeoffs show Scout, Growth, and Flagship each at 7/8 (87.5 percent) against same-size open instruct peers. Internal capability gates record Growth at 7/7 PASS and Scout at 6/7 FAIL; Scout remains under-recovered for demos. Ascension is not automatically smarter than Flagship and requires task bakeoffs. A matched Grapevine versus Flagship smoke shows mean generation rates of about 23.35 versus 141.56 tok/s (Flagship about 6.1 times faster), with Grapevine winning some exact-output cases while still failing compound identity under Ollama. Informal chat probes are qualitative only. Competitive scope is same-size open instruct; we do not claim frontier closed-model parity.
papers/05-evaluation/metadata.yaml ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ title: "Arriella Fleet Evaluation Report: Capability Gates, API Gauntlets, and Size-Tier Bakeoffs"
2
+ authors:
3
+ - Beelzebub4888
4
+ - Tcoder
5
+ affiliations:
6
+ - Infinidev Corp
7
+ categories:
8
+ - cs.CL
9
+ comments: "Evaluation report. Tables from 2026-07 gates, API gauntlet, bakeoffs, Grapevine smoke. Chat probes qualitative only."
10
+ license: apache-2.0
11
+ date: 2026-07-17
12
+ version: "1.0-arxiv"
13
+ hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
14
+ contact: https://formsubmit.co/el/sumuhu
papers/05-evaluation/paper.md ADDED
@@ -0,0 +1,149 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "Arriella Fleet Evaluation Report: Capability Gates, API Gauntlets, and Size-Tier Bakeoffs"
3
+ authors: Beelzebub4888, Tcoder
4
+ affiliations: Infinidev Corp
5
+ date: 2026-07-17
6
+ categories: [cs.CL]
7
+ version: 1.0-arxiv
8
+ license: apache-2.0
9
+ ---
10
+
11
+ # Abstract
12
+
13
+ We compile the Arriella fleet evaluation picture as of **2026-07-17** for the four core text models — Scout (~494M, Qwen2.5-0.5B), Growth (~1.2B, Llama-3.2-1B), Flagship (~1.5B, Qwen2.5-1.5B), Ascension (~1.8B, DeepSeek-R1-Distill-Qwen-1.5B) — plus the **Grapevine** Omni multimodal extension. On an RTX 5060 8 GB Blackwell Windows workstation, Flagship leads a 12-question combined API gauntlet at **10/12 (83%)** versus stock `llama3.2:1b` at **7/12 (58%)**. Size-tier bakeoffs show Scout, Growth, and Flagship each at **7/8 (87.5%)** against same-size open instruct peers. Internal capability gates record Growth at **7/7 PASS** and Scout at **6/7 FAIL**; Scout remains under-recovered for demos. Ascension is not automatically smarter than Flagship and requires task bakeoffs. A matched Grapevine vs Flagship smoke shows mean generation rates of ~**23.35** vs ~**141.56** tok/s (Flagship ~**6.1×** faster), with Grapevine winning some exact-output cases while still failing compound identity under Ollama. Informal chat probes are qualitative only. Competitive scope is **same-size open instruct**; we do not claim frontier closed-model parity.
14
+
15
+ # 1. Introduction
16
+
17
+ Evaluation for a role-scoped local fleet is not a single leaderboard number. Different suites answer different questions: internal gates catch extraction and identity failures; API gauntlets stress verbosity and format; bakeoffs fix competitive scope; Grapevine smoke measures modality + throughput. This report compiles measured tables and states what each suite does *not* prove.
18
+
19
+ # 2. Product Stance (Honest)
20
+
21
+ | Model | Role | Capability / notes | Demo priority |
22
+ |-------|------|--------------------|---------------|
23
+ | **Flagship** | General ops | Strong; best fleet API gauntlet vs stock `llama3.2:1b` | **Primary** |
24
+ | **Growth** | Domain / mid | Strong internal gate; weaker on verbose API format rubrics | **Primary** with Flagship |
25
+ | **Ascension** | Reasoning | Native DeepSeek think; **not** auto-smarter than Flagship | Secondary — task bakeoffs required |
26
+ | **Scout** | Edge / 0.5B | Mixed / fail-prone; invents specs in chat probes | **Do not lead demos** |
27
+ | **Grapevine** | Omni extension | Real vision/audio; slower; identity under Ollama still flaky | Multimodal preview only |
28
+
29
+ # 3. Suites and Hardware
30
+
31
+ | Suite | Script | Measures |
32
+ |-------|--------|----------|
33
+ | Capability gate | `fleet_benchmark.py` | Strawberry r-count, arith, spelling, identity, extraction |
34
+ | Bakeoff | `fleet_bakeoff.py` | Fleet vs same-size stock instruct |
35
+ | API gauntlet | Atlas / Ollama API harness | Multi-question pass + verbosity |
36
+ | Model card suite | `fleet_model_card_suite.py` | Broader Ollama categories |
37
+ | Grapevine vs Flagship | `benchmark_grapevine_vs_flagship.py` | Modality + smoke quality + tok/s |
38
+ | MIP smoke | load + generate + forge | Viewer trail + solid (companion MIP note) |
39
+
40
+ | Item | Value |
41
+ |------|-------|
42
+ | GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
43
+ | Python | 3.11.9 |
44
+ | OS | Windows |
45
+ | PyTorch | cu128 |
46
+
47
+ Threshold helpers: `fleet/public_benchmark_thresholds.yaml`.
48
+
49
+ # 4. Snapshot A — Internal Capability Gate (2026-07-13, thinking on)
50
+
51
+ | Model | Pass rate | Capability gate | Thinking format note |
52
+ |-------|-----------|-----------------|----------------------|
53
+ | Arriella Scout | 86% (6/7) | **FAIL** | 71% scratchpad |
54
+ | Arriella Growth | 100% (7/7) | **PASS** | 14% scratchpad |
55
+
56
+ ### Failures
57
+
58
+ - **Scout — average_speed:** extraction miss (`120 mph is their average speed.` style failure).
59
+ - **Growth:** all tests passed.
60
+
61
+ Architecture notes for scoring: thinking uses `/think` or `<scratchpad>` blocks; eval scores the **answer** block only. Vision for text tiers is Gemma3-routed, not native pixels.
62
+
63
+ # 5. Snapshot B — Combined Core API Gauntlet
64
+
65
+ Run set: `combined-core-gauntlet`, 12 questions × 4 models (post `llama3.2:1b` catch-up).
66
+
67
+ | Rank | Model | Pass | Accuracy | Verbosity | Avg words |
68
+ |------|-------|------|----------|-----------|-----------|
69
+ | 1 | **arriella-flagship** | **10/12** | **83%** | 100% | 98 |
70
+ | 2 | llama3.2:1b (stock) | 7/12 | 58% | 83% | 230 |
71
+ | 3 | arriella-scout | 5/12 | 42% | 33% | 46 |
72
+ | 4 | arriella-growth | 2/12 | 17% | 8% | 50 |
73
+
74
+ Flagship wins the head-to-head narrative against stock Llama-3.2-1B. Growth’s low score on this particular gauntlet is tied to verbosity / `Final answer:` format pressure — **not** a claim that Growth “can’t think.” Prefer gate + bakeoff alongside API numbers. Ascension was not in this four-model table; do not invent Ascension API ranks.
75
+
76
+ # 6. Snapshot C — Size-Tier Bakeoff (2026-07-13)
77
+
78
+ | Cohort | Result | Scope |
79
+ |--------|--------|-------|
80
+ | Scout vs same-size open instruct | **7/8 (87.5%)** | Same-size open instruct |
81
+ | Growth vs same-size open instruct | **7/8 (87.5%)** | Same-size open instruct |
82
+ | Flagship vs same-size open instruct | **7/8 (87.5%)** | Same-size open instruct |
83
+
84
+ Claim class: **same-size open instruct** — not Claude, not Llama-405B. Scout can win a bakeoff row and still fail the internal capability gate; both facts stand.
85
+
86
+ # 7. Snapshot D — Grapevine vs Flagship Smoke (2026-07-16)
87
+
88
+ Matched eight prompts via `ollama run --verbose`; single-run, nonzero temperature.
89
+
90
+ ## 7.1 Throughput
91
+
92
+ | Model | Mean tok/s | Range |
93
+ |-------|------------|-------|
94
+ | Grapevine | **23.35** | 17.44–36.66 |
95
+ | Flagship | **141.56** | 78.60–229.75 |
96
+
97
+ Flagship ≈ **6.1×** faster on mean generation rate.
98
+
99
+ ## 7.2 Case outcomes (summary)
100
+
101
+ | Case | Grapevine | Flagship |
102
+ |------|-----------|----------|
103
+ | Identity | Fail (invented name/company) | Pass w/ SYSTEM caveat |
104
+ | Modalities self-report | Partial | Partial |
105
+ | `47+58` | Pass | Pass |
106
+ | Exact word `banana` | Pass | Fail |
107
+ | Private phone refusal | Pass | Pass |
108
+ | 99.9% avail / 30d → 43.2 min | Fail | Fail |
109
+ | `dedupe` fence-only | Pass | Partial |
110
+ | `r` in strawberry | Fail | Pass |
111
+
112
+ Interpretation: Grapevine for real image/audio; Flagship for fast text/tools. Full per-case tok/s table: companion Grapevine paper.
113
+
114
+ # 8. Chat Probe Caveats (2026-07-17)
115
+
116
+ Informal `ollama run` identity/role probes across fleet tags: Scout and Flagship can invent or garble provenance; Growth may be terse/confused on architecture; Ascension answers briefly with think channel; Grapevine may correctly name Infinidev/devs/role yet contradict its own vision capability. Treat as **qualitative** — re-run gates before Hub claims. Older FAIL reports under `docs/archive/2026-07/VALIDATION_REPORT.md` (Jul 11) are **not** current quality without re-running.
117
+
118
+ # 9. How to Refresh Numbers
119
+
120
+ ```powershell
121
+ .\.venv\Scripts\python.exe scripts\fleet_benchmark.py
122
+ .\.venv\Scripts\python.exe scripts\fleet_bakeoff.py
123
+ .\.venv\Scripts\python.exe scripts\fleet_validate_all.py
124
+ .\.venv\Scripts\python.exe scripts\benchmark_grapevine_vs_flagship.py
125
+ ```
126
+
127
+ Paste new tables into dated files under `docs/benchmarks/` and archive superseded markdown.
128
+
129
+ # 10. Limitations
130
+
131
+ Single-workstation, mostly single-run smokes; temperature nonzero for some suites; API format rubrics can understate Growth; Ascension lacks a full Flagship head-to-head in these tables; Grapevine smoke is not a broad multimodal benchmark.
132
+
133
+ # 11. Conclusion
134
+
135
+ Across gates, gauntlets, bakeoffs, and the Grapevine smoke, the evaluation story is consistent with role-scoped deployment: **Flagship leads text ops**, **Growth is gate-strong**, **Scout is under-recovered**, **Ascension needs task bakeoffs**, and **Grapevine trades speed for native modality**. Measured tables beat slogans.
136
+
137
+ # Acknowledgments
138
+
139
+ Benchmarks use open Ollama/stock instruct baselines and Arriella factory scripts maintained by Infinidev Corp.
140
+
141
+ # References
142
+
143
+ 1. `docs/archive/2026-07/BENCHMARK_REPORT.md`
144
+ 2. `docs/archive/2026-07/BENCHMARK_API_COMPARISON.md`
145
+ 3. `docs/benchmarks/README.md`
146
+ 4. `grapevine.md` and `fleet/inkling/grapevine_vs_flagship_benchmark.json`
147
+ 5. Companion Grapevine — `docs/arxiv/02-grapevine/`
148
+ 6. Companion factory — `docs/arxiv/01-fleet-factory/`
149
+ 7. Public thresholds — `fleet/public_benchmark_thresholds.yaml`
papers/06-reasoning-format/abstract.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ Arriella fleet models expose an internal reasoning channel comparable to enterprise Ollama thinking modes. This technical note specifies the wire format used in training and Modelfiles: a /think scratchpad closed by /thinking end, followed by a user-visible answer. Ollama think:true maps the think span into the thinking channel; think:false requires a plain answer with no think markers. Ascension, the fourth core text tier on DeepSeek-R1-Distill-Qwen-1.5B, uses native deepseek_native templates with DeepSeek think markers instead of the slash-think path. Eval accepts legacy scratchpad and answer XML blocks but scores the answer body only. We state required behavior, training targets, and tooling so local clients and proxies can strip leakage and prove think on and off on consumer hardware.
papers/06-reasoning-format/metadata.yaml ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ title: "A Wire Format for Local Thinking Channels in the Arriella Fleet"
2
+ authors:
3
+ - Beelzebub4888
4
+ - Tcoder
5
+ affiliations:
6
+ - Infinidev Corp
7
+ categories:
8
+ - cs.CL
9
+ comments: "Technical note. /think /answer wire format; Ollama --think mapping; Ascension deepseek_native."
10
+ license: apache-2.0
11
+ date: 2026-07-17
12
+ version: "1.0-arxiv"
13
+ hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
14
+ contact: https://formsubmit.co/el/sumuhu
papers/06-reasoning-format/paper.md ADDED
@@ -0,0 +1,114 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "A Wire Format for Local Thinking Channels in the Arriella Fleet"
3
+ authors: Beelzebub4888, Tcoder
4
+ affiliations: Infinidev Corp
5
+ date: 2026-07-17
6
+ categories: [cs.CL]
7
+ version: 1.0-arxiv
8
+ license: apache-2.0
9
+ ---
10
+
11
+ # Abstract
12
+
13
+ Arriella fleet models expose an internal reasoning channel comparable to enterprise Ollama thinking modes. This technical note specifies the **wire format** used in training and Modelfiles: a `/think` scratchpad closed by `/thinking end`, followed by a user-visible answer. Ollama `think:true` maps the think span into the thinking channel; `think:false` requires a plain answer with no think markers. **Ascension**, the fourth core text tier on DeepSeek-R1-Distill-Qwen-1.5B (~1.8B), uses native `deepseek_native` templates with `<think>` markers instead of the slash-think path. Eval accepts legacy `<scratchpad>` / `<answer>` XML blocks but scores the answer body only. We state required behavior, training targets, and tooling so local clients and proxies can strip leakage and prove think on/off on consumer hardware (RTX 5060 8 GB, Windows, Python 3.11.9).
14
+
15
+ # 1. Introduction
16
+
17
+ Field clients need a stable contract: when thinking is enabled, scratchpad text must not pollute the user-visible answer; when disabled, markers must not appear at all. Arriella’s four core text models — Scout, Growth, Flagship, Ascension — share this requirement; Grapevine (Omni extension) is out of scope for this note’s primary templates.
18
+
19
+ # 2. Wire Format (Scout / Growth / Flagship)
20
+
21
+ When a query is received with thinking enabled:
22
+
23
+ ```
24
+ /think
25
+ Scratchpad / Reasoning / Math (optional) / Iterative Analysis
26
+ /thinking end
27
+
28
+ /answer
29
+ Final user-visible response
30
+ /answer end
31
+ ```
32
+
33
+ **Pipeline:** Query → `/think` (scratchpad, optional math, validation) → `/answer` (final response).
34
+
35
+ Ollama `--think` / API `think:true` maps `/think`…`/thinking end` to the **thinking channel**. The user always receives the answer body (plain content after the think close). In the preferred Ollama-native flow, the template **opens** `/think` at generation time — the model must not repeat the opener — then emits `/thinking end` and writes the plain answer in `message.content`.
36
+
37
+ # 3. Ollama Native Flow
38
+
39
+ ## 3.1 `think:true`
40
+
41
+ 1. Template opens `/think` (model continues inside the channel).
42
+ 2. Model writes a scratchpad — multi-step `[Step N] Input:/ Op:/ Output:/ Check:` chains for hard questions.
43
+ 3. Model emits `/thinking end` on its own line.
44
+ 4. Model writes the plain user-facing answer in `message.content`.
45
+
46
+ ## 3.2 `think:false`
47
+
48
+ Reply directly in `message.content` with **no** `/think`, `/thinking end`, `/answer`, or XML markers.
49
+
50
+ # 4. Ascension — `deepseek_native`
51
+
52
+ Fourth core tier `arriella-ascension` uses DeepSeek-R1 distill markers:
53
+
54
+ ```
55
+ <think>
56
+ scratchpad …
57
+ </think>
58
+ plain answer
59
+ ```
60
+
61
+ Ollama template (`deepseek_native`) matches official `deepseek-r1` behavior:
62
+
63
+ - `think:false` → injects empty `<think></think>` so the model skips CoT
64
+ - `think:true` → model opens `<think>` itself, then closes and answers
65
+
66
+ Bootstrap / catch-up: `scripts/fleet_ascension_catchup.py`. Ascension is **not** automatically smarter than Flagship; the format only enables a native thinking channel.
67
+
68
+ # 5. Training Targets
69
+
70
+ | Mode | Assistant `output` target |
71
+ |------|---------------------------|
72
+ | Think on (Ollama) | `{scratchpad}\n/thinking end\n{plain answer}` — **no leading `/think`** |
73
+ | Think on (HF legacy) | `/think\n…\n/thinking end\n/answer\n…\n/answer end` |
74
+ | Think off | Plain answer only (`chat_direct_anchor`) |
75
+
76
+ # 6. Required Behavior
77
+
78
+ 1. If think is enabled, enter the think channel before answering.
79
+ 2. Scratchpad may contain reasoning, optional math module, refinement.
80
+ 3. Math only when numerical computation helps — never for creative/open-ended writing.
81
+ 4. Always produce a non-empty user-visible answer after think close.
82
+ 5. Answer excludes scratchpad/math/tool tags.
83
+ 6. Never leave refusal/think tags in the final answer body.
84
+
85
+ # 7. Eval Compatibility
86
+
87
+ Older paths may emit `<scratchpad>…</scratchpad>` and `<answer>…</answer>`. Capability scoring grades the **answer** block only. Thinking-format rates in gate reports measure marker presence, not intelligence.
88
+
89
+ # 8. Tooling
90
+
91
+ | Script | Purpose |
92
+ |--------|---------|
93
+ | `enable_native_thinking_ollama.py` | Enable native templates |
94
+ | `prove_deep_think_ollama.py` | Prove think on/off |
95
+ | `atlas_ollama_proxy.py` | Strip think leakage for clients |
96
+ | `fleet_chat.py` | Chat with `--think` / vision routing |
97
+ | `fleet_ollama_template.py` | Modelfile thinking templates |
98
+
99
+ # 9. Limitations
100
+
101
+ Format compliance ≠ correctness. Scout can emit scratchpads and still fail capability gates. Single-workstation proofs; clients differ in how they surface Ollama thinking fields.
102
+
103
+ # 10. Conclusion
104
+
105
+ A small, explicit wire format — slash-think for most tiers, DeepSeek native for Ascension — makes local thinking channels auditable for field and business clients without inventing frontier reasoning claims.
106
+
107
+ # References
108
+
109
+ 1. `docs/archive/2026-07/REASONING_SPEC.md`
110
+ 2. `docs/guides/reasoning-format.md`
111
+ 3. Companion multimodal routing — `docs/arxiv/04-multimodal-routing/`
112
+ 4. Companion factory — `docs/arxiv/01-fleet-factory/`
113
+ 5. DeepSeek-R1 distill model cards on Hugging Face
114
+ 6. Ollama thinking / `think` API documentation
papers/07-mip/abstract.txt ADDED
@@ -0,0 +1 @@
 
 
1
+ Chat interfaces show what a language model said; they rarely show where attention landed inside the model's own parameter geometry. We present Model Interior Projection (MIP), Arriella's live browser viewer that samples a parameter cloud (default 120,000 display points equal to the GPU sample budget), paints a gold attention trail during decode, and forges a deterministic attention solid (tesseract) from the token trail for save and compare. MIP runs on an NVIDIA RTX 5060 8 GB Blackwell workstation under Windows with Python 3.11.9 and a threaded architecture that keeps Gradio responsive while WebGL renders at interactive rates. Invariants include locking the attention implementation for a full decode, a single WebGL iframe singleton, and deterministic forge seeds for fixed prompt and token ids. We argue MIP is the inspectability layer field and business demos need alongside Flagship and Growth chat and size-tier bakeoffs—not a replacement for evaluation, but a way to debug identity collapse and format failures that kill trust.
papers/07-mip/metadata.yaml ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ title: "Model Interior Projection: Visualizing Live Attention on a Parameter Cloud"
2
+ authors:
3
+ - Beelzebub4888
4
+ - Tcoder
5
+ affiliations:
6
+ - Infinidev Corp
7
+ categories:
8
+ - cs.HC
9
+ - cs.LG
10
+ comments: "Technical report. MIP viewer: 120k-point cloud, gold attention trail, forge tesseract, field-demo invariants."
11
+ license: apache-2.0
12
+ date: 2026-07-17
13
+ version: "1.0-arxiv"
14
+ hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
15
+ contact: https://formsubmit.co/el/sumuhu
papers/07-mip/paper.md ADDED
@@ -0,0 +1,120 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: "Model Interior Projection: Visualizing Live Attention on a Parameter Cloud"
3
+ authors: Beelzebub4888, Tcoder
4
+ affiliations: Infinidev Corp
5
+ date: 2026-07-17
6
+ categories: [cs.HC, cs.LG]
7
+ version: 1.0-arxiv
8
+ license: apache-2.0
9
+ ---
10
+
11
+ # Abstract
12
+
13
+ Chat interfaces show *what* a language model said; they rarely show *where* attention landed inside the model’s own parameter geometry. We present **Model Interior Projection (MIP)**, Arriella’s live browser viewer that samples a parameter cloud (default **120 000** display points equal to the GPU sample budget), paints a gold **attention trail** during decode, and forges a deterministic attention solid (**tesseract**) from the token trail for save and compare. MIP runs on an NVIDIA RTX 5060 8 GB Blackwell workstation under Windows with Python 3.11.9 and a threaded architecture that keeps Gradio responsive while WebGL renders at interactive rates. Invariants include locking the attention implementation for a full decode, a single WebGL iframe singleton, and deterministic forge seeds for fixed prompt and token ids. We argue MIP is the inspectability layer field and business demos need alongside Flagship/Growth chat and size-tier bakeoffs — not a replacement for evaluation, but a way to debug identity collapse and format failures that kill trust.
14
+
15
+ # 1. Introduction
16
+
17
+ ## 1.1 Motivation
18
+
19
+ Enterprise demos fail on invisible failures: the model answered, but attention never settled on the structure operators expected. Stock chatbot UIs do not expose that geometry. MIP maps live decode onto a density sample of real parameter index space — not decorative eye candy.
20
+
21
+ ## 1.2 Placement in the Arriella stack
22
+
23
+ MIP loads fleet slots (Scout, Growth, Flagship, Ascension), installed Ollama ids, Hugging Face catalog entries, and custom paths. Grapevine (Omni extension) may be loaded when weights are available; MIP does not change the four-core text stance. Prefer port **7866** (Heretic GUI often occupies **7865**).
24
+
25
+ # 2. Related Work
26
+
27
+ Activation atlases and attention visualizations typically operate on tokens or layers in abstract 2D. MIP instead projects **parameter-space samples** into a 3D force layout and paints **per-token attention focus** during generation, then materializes a forgeable solid for cross-run comparison.
28
+
29
+ # 3. Architecture
30
+
31
+ ## 3.1 Threads
32
+
33
+ ```
34
+ mip-gen → GPU decode + sparse attention capture
35
+ mip-attn-pump → coalesce frames (never block Gradio)
36
+ mip-cloud-sim → ~48 Hz force layout + HUB paint
37
+ browser rAF → WebGL only (spring lerp / extrapolate)
38
+ ```
39
+
40
+ | Component | Path |
41
+ |-----------|------|
42
+ | Gradio + session | `scripts/fleet_mip_web.py` |
43
+ | WebGL `/view` + `/shape` | `scripts/mip_viewport_app.py` |
44
+ | Generate / hooks | `scripts/mip_pipeline.py` |
45
+ | Tesseract forge / compare | `scripts/mip_attention_shape.py` |
46
+ | Desktop MIP (alternate) | `scripts/fleet_mip_live.py` |
47
+
48
+ ## 3.2 Display budget
49
+
50
+ Default: `DISPLAY_POINTS == GPU_SAMPLE_BUDGET == 120_000`. Raising far past that costs interactivity on 8 GB. Each display point is a density sample over the model’s real parameter index space.
51
+
52
+ # 4. Features
53
+
54
+ | Feature | What it does |
55
+ |---------|----------------|
56
+ | Model load | Fleet slots, Ollama ids, HF catalog, custom HF path |
57
+ | HF token field | Persists to `fleet/.mip_hf_token` (gitignored) |
58
+ | Generate | Streams answer; trail grows one node per decoded token |
59
+ | Attention nodes / JSON | Per-step focus, prompt-mass, residual, top tokens |
60
+ | Forge tesseract | Deterministic solid from trail → `fleet/mip_shapes/` |
61
+ | Repeat + compare | Same prompt N× → forge each → Jaccard / vertex RMSD / seed table |
62
+ | Morph home layout | Per-model seeded blends (helix, vortex, …) so models don’t share one V-shape |
63
+
64
+ # 5. Method — Run Surface
65
+
66
+ ```powershell
67
+ .\.venv\Scripts\python.exe scripts\fleet_mip_web.py --port 7866 --device cuda --max-points 120000
68
+ ```
69
+
70
+ | URL | Role |
71
+ |-----|------|
72
+ | http://127.0.0.1:7866/ | Gradio UI |
73
+ | http://127.0.0.1:7866/view | Fullscreen WebGL |
74
+ | http://127.0.0.1:7866/shape | Shape viewer |
75
+
76
+ ## 5.1 Hardware
77
+
78
+ | Item | Value |
79
+ |------|-------|
80
+ | GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
81
+ | PyTorch | cu128 |
82
+ | Python | 3.11.9 |
83
+ | OS | Windows |
84
+
85
+ # 6. Invariants
86
+
87
+ 1. **Attention backend locked** for a full decode — never flip SDPA↔eager mid-KV cache.
88
+ 2. **One WebGL iframe singleton** on `document.body` — Gradio remounts must not spawn new contexts.
89
+ 3. **Deterministic forge:** same prompt + same token ids → same forge seed / solid.
90
+ 4. **Display budget coherence:** `DISPLAY_POINTS` equals `GPU_SAMPLE_BUDGET`.
91
+
92
+ # 7. Why It Matters for Field Demos
93
+
94
+ | Chat shows | MIP shows |
95
+ |------------|-----------|
96
+ | Final tokens | Where attention painted on the parameter cloud |
97
+ | Pass/fail scores | Geometry of a run (forge + compare) |
98
+ | Identity claims | Whether decode focused on expected structure |
99
+
100
+ MIP is the demo centerpiece alongside Flagship/Growth chat — not a replacement for bakeoffs (Scout/Growth/Flagship **7/8** size-tier; Flagship **10/12** API gauntlet), but the inspectability layer those bakeoffs deserve. Scout remains under-recovered; MIP can still load it for diagnosis without making it a sales hero.
101
+
102
+ # 8. Limitations
103
+
104
+ Interactive budgets force sparse sampling — the cloud is not a full weight dump. Attention paint depends on capture hooks and model support. 8 GB VRAM constrains concurrent fleet loads. MIP does not prove answer correctness by itself.
105
+
106
+ # 9. Conclusion
107
+
108
+ Model Interior Projection turns decode into a visible, forgeable geometric object. For Arriella’s role-scoped local fleet, that inspectability is a product feature: field and business users can ask not only “what did it say?” but “where did attention land?”
109
+
110
+ # Acknowledgments
111
+
112
+ Built with Gradio, WebGL, and PyTorch CUDA stacks on Blackwell consumer hardware.
113
+
114
+ # References
115
+
116
+ 1. `docs/guides/mip-viewer.md`
117
+ 2. Hub MIP note — `docs/papers/hub/arriella-fleet-paper/MIP.md`
118
+ 3. Companion factory — `docs/arxiv/01-fleet-factory/`
119
+ 4. Companion evaluation — `docs/arxiv/05-evaluation/`
120
+ 5. Scripts: `fleet_mip_web.py`, `mip_pipeline.py`, `mip_attention_shape.py`, `mip_viewport_app.py`
papers/README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Arriella arXiv manuscript set
2
+
3
+ **Directory:** `docs/arxiv/`
4
+ **Purpose:** Publication-ready manuscripts for **arXiv** → **Hugging Face Papers**.
5
+ **Authors:** Beelzebub4888, Tcoder · **Affiliation:** Infinidev Corp
6
+ **Contact:** https://formsubmit.co/el/sumuhu · **Hub user:** [UnaverageTech411](https://huggingface.co/UnaverageTech411)
7
+
8
+ ## What this is (and is not)
9
+
10
+ | Correct | Incorrect |
11
+ |---------|-----------|
12
+ | Submit LaTeX/PDF to **arxiv.org** | Upload papers as Hugging Face **Spaces** |
13
+ | Index announced IDs on **hf.co/papers/<id>** | Fake **model** repos that only contain markdown |
14
+ | Keep Spaces for **runnable demos** only (`Learnit`, etc.) | Treat Spaces as a paper host |
15
+
16
+ Hugging Face Paper Pages are built on **arXiv**. There is no Hub repo type that replaces arXiv for papers.
17
+
18
+ ## Manuscript index
19
+
20
+ | ID | Title | Categories | Path |
21
+ |----|-------|------------|------|
22
+ | 01 | Arriella: A Local Fleet Factory for Role-Scoped Small Language Models | cs.CL, cs.LG | [`01-fleet-factory/`](01-fleet-factory/) |
23
+ | 02 | Arriella Grapevine: A Local Omni Multimodal Extension | cs.CV, cs.CL | [`02-grapevine/`](02-grapevine/) |
24
+ | 03 | Honest Capability Ingestion (Eat System) | cs.LG, cs.CL | [`03-eat-system/`](03-eat-system/) |
25
+ | 04 | Multimodal Routing for Text-Only Fleet Tiers | cs.CL, cs.CV | [`04-multimodal-routing/`](04-multimodal-routing/) |
26
+ | 05 | Arriella Fleet Evaluation Report | cs.CL | [`05-evaluation/`](05-evaluation/) |
27
+ | 06 | Fleet Internal Reasoning Wire Format | cs.CL | [`06-reasoning-format/`](06-reasoning-format/) |
28
+ | 07 | Model Interior Projection (MIP) | cs.HC, cs.LG | [`07-mip/`](07-mip/) |
29
+
30
+ Each folder: `paper.md`, `abstract.txt`, `metadata.yaml` (add `arxiv_id` / `hf_papers` after acceptance).
31
+
32
+ Sources merged from `docs/papers/`, `docs/guides/`, `docs/benchmarks/`, and `docs/archive/2026-07/`.
33
+
34
+ ## Workflow
35
+
36
+ Detailed steps: [`SUBMISSION.md`](SUBMISSION.md)
37
+
38
+ ```powershell
39
+ # 1) Build arXiv source zips
40
+ .\.venv\Scripts\python.exe scripts\package_arxiv.py
41
+
42
+ # 2) Upload each zip at https://arxiv.org/submit (human step)
43
+
44
+ # 3) After announcement, index on HF Papers
45
+ .\.venv\Scripts\python.exe scripts\index_hf_papers.py --arxiv-id YYYY.NNNNN --manuscript 01-fleet-factory
46
+ ```
47
+
48
+ Packaged zips land in `docs/arxiv/submission-packages/` (gitignored if large; regenerate anytime).
49
+
50
+ ## Stance rules
51
+
52
+ - Foundations are clay; Arriella products are factory outputs.
53
+ - Same-size open instruct competition only — no frontier parity claims.
54
+ - Scout under-recovered; Ascension not automatically smarter than Flagship.
55
+ - Grapevine is a multimodal **extension** (no Inkling weights).
56
+ - Prefer measured tables over slogans.
papers/SUBMISSION.md ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Submitting Arriella manuscripts to arXiv and Hugging Face Papers
2
+
3
+ ## Why not Spaces or model repos?
4
+
5
+ - **Spaces** = runnable apps / demos.
6
+ - **Models** = weight checkpoints + model cards.
7
+ - **Papers** on Hugging Face = pages indexed from **arXiv** (`https://huggingface.co/papers/<arxiv-id>`).
8
+
9
+ There is no supported “upload a PDF as a Paper Page without arXiv” path.
10
+
11
+ ## Step 1 — Package sources
12
+
13
+ ```powershell
14
+ .\.venv\Scripts\python.exe scripts\package_arxiv.py
15
+ ```
16
+
17
+ Creates `docs/arxiv/submission-packages/<manuscript>.zip` containing `paper.tex` (+ `abstract.txt`).
18
+
19
+ ## Step 2 — Submit on arXiv
20
+
21
+ 1. Log in at https://arxiv.org/submit
22
+ 2. For each manuscript, use categories from that folder’s `metadata.yaml`
23
+ 3. Upload the corresponding zip (Process with TeX)
24
+ 4. Paste `abstract.txt` into the abstract field
25
+ 5. Complete license / metadata and submit
26
+
27
+ Suggested order: **01-fleet-factory** → **02-grapevine** → **03-eat-system** → **05-evaluation** → shorter companions (04, 06, 07).
28
+
29
+ ## Step 3 — Index on Hugging Face Papers
30
+
31
+ After the paper is announced (ID like `2607.01234`):
32
+
33
+ ```powershell
34
+ .\.venv\Scripts\python.exe scripts\index_hf_papers.py --arxiv-id 2607.01234 --manuscript 01-fleet-factory
35
+ ```
36
+
37
+ Or open `https://huggingface.co/papers/2607.01234` once to trigger indexing.
38
+
39
+ Then:
40
+
41
+ 1. Open the paper page → claim authorship if listed
42
+ 2. On future **model** repos, add the arXiv URL in the model card README so HF auto-tags `arxiv:<id>`
43
+ 3. Optionally show the paper on your HF profile (Settings → Papers)
44
+
45
+ ## Step 4 — Link models (when weights are published)
46
+
47
+ Model cards should cite papers like:
48
+
49
+ ```markdown
50
+ Paper: https://arxiv.org/abs/YYYY.NNNNN
51
+ HF Papers: https://huggingface.co/papers/YYYY.NNNNN
52
+ ```
53
+
54
+ Do **not** create model repos that contain only paper markdown.
55
+
56
+ ## Local SoT
57
+
58
+ | Path | Role |
59
+ |------|------|
60
+ | `docs/arxiv/*/paper.md` | Editable manuscript source |
61
+ | `docs/arxiv/submission-packages/` | Generated LaTeX zips |
62
+ | `docs/archive/2026-07/` | Historical only |
63
+ | `docs/papers/` | Product whitepaper / drafts (not HF Paper Pages) |
whitepaper.md ADDED
@@ -0,0 +1,163 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Arriella Fleet Whitepaper
2
+
3
+ **Scout · Growth · Flagship · Ascension — plus Grapevine multimodal & Model Interior Projection**
4
+
5
+ *Version 4.1 · July 2026*
6
+
7
+ **arXiv manuscripts (publication SoT):** [`../arxiv/`](../arxiv/) · submit via [`../arxiv/SUBMISSION.md`](../arxiv/SUBMISSION.md) → HF Papers after arXiv ID
8
+
9
+ ---
10
+
11
+ ## Read this first
12
+
13
+ Arriella is a **local training factory** that turns open instruct foundations into named small LMs you own on disk, plus a **Model Interior Projection (MIP)** viewer that makes inference inspectable in 3D — attention trails on a real parameter cloud, not a black-box chat box.
14
+
15
+ Organization: **Infinidev Corp** (Infinidev). Lead developers: **Beelzebub4888** and **Tcoder**.
16
+
17
+ ### What problem we solve
18
+
19
+ 1. Useful custom models on a consumer GPU (8 GB Blackwell, Windows)
20
+ 2. **Role-scoped tiers** for field and business use — not one generic chatbot
21
+ 3. Continuous improvement via **eat** (weight ingest / distill) and **grow** (post-deploy LoRA)
22
+ 4. Stability knobs: enterprise base blend, capability/math/thinking anchors, gates before Ollama
23
+ 5. A product nobody else ships: **live interior visualization of decode**
24
+ 6. A separate **native multimodal** extension when text routing is not enough
25
+
26
+ ### What “Arriella” means
27
+
28
+ | Sense | Meaning |
29
+ |-------|---------|
30
+ | Project | This repo — scripts, configs, `fleet/`, docs, MIP |
31
+ | Persona | System identity in datasets + chat |
32
+ | Dataset | `arriella_qa` (~90k Pile-derived Alpaca records) |
33
+ | Core products | `arriella-scout`, `arriella-growth`, `arriella-flagship`, `arriella-ascension` |
34
+ | Extension | `arriella-grapevine` (Omni multimodal — not a fifth core text model) |
35
+
36
+ Arriella is **not** a Meta/Alibaba/DeepSeek foundation model. Foundations are clay; products are what comes out of the factory.
37
+
38
+ ---
39
+
40
+ ## Product thesis — stable models for fields & business
41
+
42
+ Enterprise and field deployments fail when a single mid-size chat model is asked to be edge-fast, domain-deep, reason-heavy, and multimodal at once. Arriella ships **specialists with shared factory discipline**:
43
+
44
+ | Need | Route to | Why |
45
+ |------|----------|-----|
46
+ | Low VRAM / high throughput | Scout | Smallest core text tier |
47
+ | Domain QA / continuation | Growth | Trained on full Arriella QA pile |
48
+ | General instruction ops | Flagship | Heretic + premium teacher distill |
49
+ | Explicit step-by-step reasoning | Ascension | DeepSeek-R1 distill native think |
50
+ | Image / audio in the loop | Grapevine | Qwen2.5-Omni-3B student |
51
+
52
+ Reliability comes from **gates and anchors**, not slogans: capability / math / thinking / identity / fleet-spec datasets, optional enterprise base blend (~8–15% foundation retention), bakeoffs vs same-size stock instruct, and honest modality claims.
53
+
54
+ ---
55
+
56
+ ## Fleet tiers (Jul 2026 stance)
57
+
58
+ ### Core text fleet (exactly four)
59
+
60
+ | Tier | Size (Ollama) | Foundation | Training path | Product stance |
61
+ |------|---------------|------------|---------------|----------------|
62
+ | **Flagship** | ~1.5B | Qwen2.5-1.5B-Instruct | Heretic → premium QLoRA distill | Primary quality / general ops |
63
+ | **Growth** | ~1.2B | Llama-3.2-1B-Instruct | LLaMA-Factory on `arriella_qa` | Primary mid / domain tier |
64
+ | **Ascension** | ~1.8B | DeepSeek-R1-Distill-Qwen-1.5B | LLaMA-Factory + Flagship catch-up | Reasoning / native think — **not** automatically smarter than Flagship |
65
+ | **Scout** | ~494M | Qwen2.5-0.5B-Instruct | Heretic → QLoRA | Present but **currently underpowered** — edge experiments, not demos |
66
+
67
+ Canonical numbers and truth rules: [`fleet/CORE_FLEET_SPEC.md`](../../fleet/CORE_FLEET_SPEC.md). Benchmarks: [../benchmarks/README.md](../benchmarks/README.md).
68
+
69
+ ### Multimodal extension (not core text)
70
+
71
+ | Product | Foundation | Stance |
72
+ |---------|------------|--------|
73
+ | **Grapevine** | Qwen2.5-Omni-3B | Technical preview for vision/audio; modular runtime LoRA + mmproj. Inkling is a capability target only — no Inkling weights. |
74
+
75
+ Guide: [../guides/grapevine.md](../guides/grapevine.md). HF draft: [grapevine-hf.md](grapevine-hf.md).
76
+
77
+ ---
78
+
79
+ ## Training framework
80
+
81
+ ```
82
+ foundation HF weights
83
+ ├─ Path A (Scout / Flagship): Heretic abliteration → QLoRA distill → merge
84
+ ├─ Path B (Growth / Ascension): LLaMA-Factory LoRA → merge
85
+ └─ Path C (Grapevine): Omni Thinker QLoRA → merge / runtime adapter → GGUF + mmproj
86
+
87
+ fleet/<tier>/model/ (standalone HF) | fleet/inkling/ (Grapevine)
88
+
89
+ enterprise base blend (optional) + capability / fleet-spec anchors
90
+
91
+ optional eat (weight ingest / distill) + post-deploy grow
92
+
93
+ GGUF → ollama run arriella-*
94
+ ```
95
+
96
+ **Heretic** abliterates refusal directions (not fine-tuning). Distillation then teaches what to say under QLoRA.
97
+
98
+ **Pufferfish** in this repo is the **long-run policy / WebUI preset layer** (`fleet_pufferfish.py`, `arriella_integration/`), not the upstream LightLM trainer as the primary engine.
99
+
100
+ Orchestrator: `scripts/train_fleet.py` + `fleet/fleet_manifest.yaml`.
101
+
102
+ ---
103
+
104
+ ## Eat & grow
105
+
106
+ After merge, capabilities improve by:
107
+
108
+ - **Weight ingest** — same-arch tensor merge (linear / TIES / DARE-TIES / …)
109
+ - **Distill grow** — cross-architecture teacher imitation (prefer larger teachers)
110
+ - **Organic grow** — post-deploy LoRA on anchors / datasets
111
+ - **Enterprise align** — base-preservation blend + capability re-eval (`fleet_enterprise_align.py`)
112
+
113
+ Honest language SoT: [../guides/eat-system.md](../guides/eat-system.md).
114
+
115
+ ---
116
+
117
+ ## MIP — Model Interior Projection
118
+
119
+ MIP loads a HF/Ollama-backed checkpoint, samples parameter space into ≤120k GPU display points, and during decode:
120
+
121
+ - Paints prompt-specific attention / residual activity on the cloud
122
+ - Traces a gold polyline (one node per generated token)
123
+ - Forges a deterministic projected **tesseract** from that trail
124
+ - Can **repeat** a prompt N times and **compare** solids (seed, tokens, geometry)
125
+
126
+ Guide: [../guides/mip-viewer.md](../guides/mip-viewer.md). Entry: `scripts/fleet_mip_web.py`.
127
+
128
+ This is the differentiator. Chat UIs show tokens. MIP shows **where** attention landed in the model’s own geometry.
129
+
130
+ ---
131
+
132
+ ## Multimodal (honest)
133
+
134
+ **Core text tiers** do not ingest raw pixels on 8 GB. Images go Gemma3 → categorized text → fleet model. Thinking/vision behaviors are **ingested** via teacher traces.
135
+
136
+ **Grapevine** is the native Omni path (text + image + audio in Ollama; video validated pre-export). Details: [multimodal.md](multimodal.md), [../guides/grapevine.md](../guides/grapevine.md).
137
+
138
+ ---
139
+
140
+ ## Competitive posture
141
+
142
+ - Compete with **same-size open instruct** checkpoints via bakeoffs.
143
+ - Do not claim frontier closed-model parity.
144
+ - Prefer measured tables in `docs/benchmarks/` over slogans.
145
+ - Prefer **role fit** (field/business job) over “one model to rule them all.”
146
+
147
+ ---
148
+
149
+ ## Publication (arXiv → Hugging Face Papers)
150
+
151
+ - Manuscript set: [`../arxiv/`](../arxiv/)
152
+ - Workflow: [`../arxiv/SUBMISSION.md`](../arxiv/SUBMISSION.md)
153
+ - Hub guide: [`../guides/hugging-face-publish.md`](../guides/hugging-face-publish.md)
154
+
155
+ Do **not** host papers as Spaces or model-only-markdown repos. Spaces are for runnable demos; Paper Pages require arXiv IDs.
156
+
157
+ ---
158
+
159
+ ## Document history
160
+
161
+ - v2.5 — fleet narrative without MIP as product centerpiece (`docs/archive/2026-07/WHITEPAPER.md`)
162
+ - v3.0 — reorganized docs; MIP as unique product; honest Scout status; three-tier only
163
+ - v4.0 — four-core text fleet + Grapevine extension; field/business thesis; HF paper prep