Transformers
English
arriella
infinidev
documentation
technical-report
model-card
local-llm
not-for-inference
Instructions to use UnaverageTech411/arriella-docs with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use UnaverageTech411/arriella-docs with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("UnaverageTech411/arriella-docs", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Publish Arriella fleet documentation collection (docs only, no weights)
Browse files- README.md +102 -0
- benchmarks.md +74 -0
- fleet-spec.md +30 -0
- grapevine-benchmark-narrative.md +132 -0
- guides/eat-system.md +47 -0
- guides/fleet-training.md +92 -0
- guides/grapevine.md +61 -0
- guides/mip-viewer.md +58 -0
- guides/reasoning-format.md +59 -0
- hf-card-stubs/ascension.md +31 -0
- hf-card-stubs/flagship.md +62 -0
- hf-card-stubs/grapevine.md +38 -0
- hf-card-stubs/growth.md +36 -0
- hf-card-stubs/scout.md +32 -0
- model-cards/ascension.md +49 -0
- model-cards/flagship.md +51 -0
- model-cards/grapevine.md +47 -0
- model-cards/growth.md +50 -0
- model-cards/scout.md +48 -0
- multimodal.md +59 -0
- papers/01-fleet-factory/abstract.txt +1 -0
- papers/01-fleet-factory/metadata.yaml +16 -0
- papers/01-fleet-factory/paper.md +191 -0
- papers/02-grapevine/abstract.txt +1 -0
- papers/02-grapevine/metadata.yaml +15 -0
- papers/02-grapevine/paper.md +241 -0
- papers/03-eat-system/abstract.txt +1 -0
- papers/03-eat-system/metadata.yaml +15 -0
- papers/03-eat-system/paper.md +140 -0
- papers/04-multimodal-routing/abstract.txt +1 -0
- papers/04-multimodal-routing/metadata.yaml +15 -0
- papers/04-multimodal-routing/paper.md +160 -0
- papers/05-evaluation/abstract.txt +1 -0
- papers/05-evaluation/metadata.yaml +14 -0
- papers/05-evaluation/paper.md +149 -0
- papers/06-reasoning-format/abstract.txt +1 -0
- papers/06-reasoning-format/metadata.yaml +14 -0
- papers/06-reasoning-format/paper.md +114 -0
- papers/07-mip/abstract.txt +1 -0
- papers/07-mip/metadata.yaml +15 -0
- papers/07-mip/paper.md +120 -0
- papers/README.md +56 -0
- papers/SUBMISSION.md +63 -0
- whitepaper.md +163 -0
README.md
ADDED
|
@@ -0,0 +1,102 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
license: apache-2.0
|
| 5 |
+
library_name: transformers
|
| 6 |
+
tags:
|
| 7 |
+
- arriella
|
| 8 |
+
- infinidev
|
| 9 |
+
- documentation
|
| 10 |
+
- technical-report
|
| 11 |
+
- model-card
|
| 12 |
+
- local-llm
|
| 13 |
+
- not-for-inference
|
| 14 |
+
pretty_name: Arriella Fleet Documentation
|
| 15 |
+
---
|
| 16 |
+
|
| 17 |
+
# Arriella Fleet Documentation
|
| 18 |
+
|
| 19 |
+
> **This Hub “model” contains documentation only — no neural network weights.**
|
| 20 |
+
> It is the public library for the Arriella fleet: papers, whitepaper, model cards, fleet spec, benchmarks, and guides.
|
| 21 |
+
> Inference weights (when published) will be separate model repos.
|
| 22 |
+
|
| 23 |
+
| | |
|
| 24 |
+
|--|--|
|
| 25 |
+
| Organization | **Infinidev Corp** |
|
| 26 |
+
| Authors / leads | **Beelzebub4888**, **Tcoder** |
|
| 27 |
+
| Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
|
| 28 |
+
| Contact | https://formsubmit.co/el/sumuhu |
|
| 29 |
+
|
| 30 |
+
## Why a model repo?
|
| 31 |
+
|
| 32 |
+
Hugging Face discovers technical material through model/dataset cards. Until papers have arXiv IDs (and appear on [HF Papers](https://huggingface.co/papers)), this repository is the single place to read the full Arriella documentation set. After arXiv acceptance, Paper Pages will be linked from here and from weight repos.
|
| 33 |
+
|
| 34 |
+
**Spaces** remain for runnable demos only. **This repo** is the docs library.
|
| 35 |
+
|
| 36 |
+
## Fleet at a glance
|
| 37 |
+
|
| 38 |
+
| Product | Role | Card |
|
| 39 |
+
|---------|------|------|
|
| 40 |
+
| **Flagship** | General ops (primary) | [`model-cards/flagship.md`](model-cards/flagship.md) |
|
| 41 |
+
| **Growth** | Domain / instruction growth | [`model-cards/growth.md`](model-cards/growth.md) |
|
| 42 |
+
| **Ascension** | Native DeepSeek-style reasoning | [`model-cards/ascension.md`](model-cards/ascension.md) |
|
| 43 |
+
| **Scout** | Edge / low-VRAM (under-recovered) | [`model-cards/scout.md`](model-cards/scout.md) |
|
| 44 |
+
| **Grapevine** | Omni multimodal *extension* | [`model-cards/grapevine.md`](model-cards/grapevine.md) |
|
| 45 |
+
|
| 46 |
+
Canonical identity sheet: [`fleet-spec.md`](fleet-spec.md)
|
| 47 |
+
|
| 48 |
+
## Start reading
|
| 49 |
+
|
| 50 |
+
1. [`whitepaper.md`](whitepaper.md) — product thesis
|
| 51 |
+
2. [`papers/01-fleet-factory/paper.md`](papers/01-fleet-factory/paper.md) — factory technical report
|
| 52 |
+
3. [`papers/02-grapevine/paper.md`](papers/02-grapevine/paper.md) — Grapevine Omni report
|
| 53 |
+
4. [`benchmarks.md`](benchmarks.md) — measured results
|
| 54 |
+
5. [`model-cards/`](model-cards/) — per-tier cards
|
| 55 |
+
|
| 56 |
+
### Full paper set (`papers/`)
|
| 57 |
+
|
| 58 |
+
| Folder | Topic |
|
| 59 |
+
|--------|--------|
|
| 60 |
+
| `01-fleet-factory` | Local fleet factory |
|
| 61 |
+
| `02-grapevine` | Omni multimodal extension |
|
| 62 |
+
| `03-eat-system` | Honest weight ingest / distill |
|
| 63 |
+
| `04-multimodal-routing` | Caption-routed vision for text tiers |
|
| 64 |
+
| `05-evaluation` | Gates, gauntlets, bakeoffs |
|
| 65 |
+
| `06-reasoning-format` | Think / answer wire format |
|
| 66 |
+
| `07-mip` | Model Interior Projection |
|
| 67 |
+
|
| 68 |
+
arXiv submission notes: [`papers/SUBMISSION.md`](papers/SUBMISSION.md)
|
| 69 |
+
|
| 70 |
+
### Guides
|
| 71 |
+
|
| 72 |
+
- [`guides/fleet-training.md`](guides/fleet-training.md)
|
| 73 |
+
- [`guides/eat-system.md`](guides/eat-system.md)
|
| 74 |
+
- [`guides/grapevine.md`](guides/grapevine.md)
|
| 75 |
+
- [`guides/mip-viewer.md`](guides/mip-viewer.md)
|
| 76 |
+
- [`guides/reasoning-format.md`](guides/reasoning-format.md)
|
| 77 |
+
|
| 78 |
+
### Extra
|
| 79 |
+
|
| 80 |
+
- [`grapevine-benchmark-narrative.md`](grapevine-benchmark-narrative.md) — Grapevine vs Flagship smoke
|
| 81 |
+
- [`multimodal.md`](multimodal.md) — multimodal architecture
|
| 82 |
+
- [`hf-card-stubs/`](hf-card-stubs/) — YAML stubs for future weight repos
|
| 83 |
+
|
| 84 |
+
## Honest limitations
|
| 85 |
+
|
| 86 |
+
- No weights in this repository — do not load it with `AutoModel`.
|
| 87 |
+
- Scout is not demo-ready; Ascension is not automatically smarter than Flagship.
|
| 88 |
+
- Grapevine is a technical preview multimodal extension (no Inkling weights).
|
| 89 |
+
- Headline benchmarks are single-workstation (RTX 5060 8 GB).
|
| 90 |
+
|
| 91 |
+
## Citation
|
| 92 |
+
|
| 93 |
+
```bibtex
|
| 94 |
+
@misc{arriella2026docs,
|
| 95 |
+
title = {Arriella Fleet Documentation},
|
| 96 |
+
author = {Beelzebub4888 and Tcoder},
|
| 97 |
+
year = {2026},
|
| 98 |
+
howpublished = {Infinidev Corp / Hugging Face},
|
| 99 |
+
url = {https://huggingface.co/UnaverageTech411/arriella-docs},
|
| 100 |
+
note = {Documentation collection; see papers/ for technical reports}
|
| 101 |
+
}
|
| 102 |
+
```
|
benchmarks.md
ADDED
|
@@ -0,0 +1,74 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Benchmarks — current picture
|
| 2 |
+
|
| 3 |
+
Last rewritten: **2026-07-17** (four-core + Grapevine docs alignment).
|
| 4 |
+
Raw dated snapshots: [`../archive/2026-07/`](../archive/2026-07/).
|
| 5 |
+
|
| 6 |
+
## Product stance (honest)
|
| 7 |
+
|
| 8 |
+
| Model | Role | Capability / notes | Demo priority |
|
| 9 |
+
|-------|------|--------------------|---------------|
|
| 10 |
+
| **Flagship** | General ops | Strong; historically best fleet API gauntlet vs stock `llama3.2:1b` | **Primary** |
|
| 11 |
+
| **Growth** | Domain / mid | Strong internal gate; weaker on verbose API format rubrics | **Primary** with Flagship |
|
| 12 |
+
| **Ascension** | Reasoning | Native DeepSeek think; **not** auto-smarter than Flagship | Secondary — task bakeoffs required |
|
| 13 |
+
| **Scout** | Edge / 0.5B | Mixed / fail-prone; invents specs in chat probes | **Do not lead demos** |
|
| 14 |
+
| **Grapevine** | Omni extension | Real vision/audio; slower; identity under Ollama still flaky | Multimodal preview only |
|
| 15 |
+
|
| 16 |
+
Scout remains in the factory and MIP can load it; treat as **experimental**, not a sales hero.
|
| 17 |
+
|
| 18 |
+
## Suites we actually run
|
| 19 |
+
|
| 20 |
+
| Suite | Script | Measures |
|
| 21 |
+
|-------|--------|----------|
|
| 22 |
+
| Capability gate | `fleet_benchmark.py` / capability eval | Strawberry r-count, arith, spelling, identity |
|
| 23 |
+
| Bakeoff | `fleet_bakeoff.py` | Fleet vs same-size stock instruct |
|
| 24 |
+
| API gauntlet | Atlas / Ollama API harness | Multi-question pass + verbosity |
|
| 25 |
+
| Model card suite | `fleet_model_card_suite.py` | Broader Ollama categories |
|
| 26 |
+
| Grapevine vs Flagship | `benchmark_grapevine_vs_flagship.py` | Modality + smoke quality |
|
| 27 |
+
| MIP smoke | load + generate + forge | Viewer still produces trail + solid |
|
| 28 |
+
|
| 29 |
+
Threshold helpers: `fleet/public_benchmark_thresholds.yaml`.
|
| 30 |
+
|
| 31 |
+
## Snapshot A — internal capability (2026-07-13, thinking on)
|
| 32 |
+
|
| 33 |
+
From archived `BENCHMARK_REPORT.md`:
|
| 34 |
+
|
| 35 |
+
| Model | Pass | Gate | Notes |
|
| 36 |
+
|-------|------|------|-------|
|
| 37 |
+
| Scout | 6/7 (86%) | FAIL | Missed average_speed extraction |
|
| 38 |
+
| Growth | 7/7 (100%) | PASS | All tests passed |
|
| 39 |
+
|
| 40 |
+
## Snapshot B — combined core API gauntlet (post catch-up)
|
| 41 |
+
|
| 42 |
+
From archived `BENCHMARK_API_COMPARISON.md` (`combined-core-gauntlet`, 12 questions):
|
| 43 |
+
|
| 44 |
+
| Rank | Model | Pass | Accuracy |
|
| 45 |
+
|------|-------|------|----------|
|
| 46 |
+
| 1 | **arriella-flagship** | 10/12 | 83% |
|
| 47 |
+
| 2 | llama3.2:1b (stock) | 7/12 | 58% |
|
| 48 |
+
| 3 | arriella-scout | 5/12 | 42% |
|
| 49 |
+
| 4 | arriella-growth | 2/12 | 17% |
|
| 50 |
+
|
| 51 |
+
Flagship wins the head-to-head narrative. Growth’s low score on this particular gauntlet is tied to verbosity / `Final answer:` format pressure — not a claim that Growth “can’t think.” Prefer gate + bakeoff alongside API numbers.
|
| 52 |
+
|
| 53 |
+
## Snapshot C — Grapevine vs Flagship (2026-07-16 smoke)
|
| 54 |
+
|
| 55 |
+
See [`../../grapevine.md`](../../grapevine.md) and `fleet/inkling/grapevine_vs_flagship_benchmark.json`. Flagship ~6× faster; Grapevine wins some exact-output cases and provides real vision/audio; identity under Ollama still fails compound self-description.
|
| 56 |
+
|
| 57 |
+
## Chat probe notes (2026-07-17)
|
| 58 |
+
|
| 59 |
+
Informal `ollama run` identity/role probe across all five tags: Scout and Flagship still invent or garble provenance; Growth was terse/confused on architecture; Ascension answered briefly with think channel; Grapevine correctly named Infinidev/devs/role but contradicted its own vision capability. Treat as qualitative — re-run gates before Hub claims.
|
| 60 |
+
|
| 61 |
+
## Older FAIL reports
|
| 62 |
+
|
| 63 |
+
`VALIDATION_REPORT.md` / early context tests (Jul 11) are **archived**. Do not paste them as current quality without re-running.
|
| 64 |
+
|
| 65 |
+
## How to refresh numbers
|
| 66 |
+
|
| 67 |
+
```powershell
|
| 68 |
+
.\.venv\Scripts\python.exe scripts\fleet_benchmark.py
|
| 69 |
+
.\.venv\Scripts\python.exe scripts\fleet_bakeoff.py
|
| 70 |
+
.\.venv\Scripts\python.exe scripts\fleet_validate_all.py
|
| 71 |
+
.\.venv\Scripts\python.exe scripts\benchmark_grapevine_vs_flagship.py
|
| 72 |
+
```
|
| 73 |
+
|
| 74 |
+
Paste new tables into this file (or a dated file under `docs/benchmarks/`) and move superseded markdown to `docs/archive/`.
|
fleet-spec.md
ADDED
|
@@ -0,0 +1,30 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Arriella Core Fleet Specification
|
| 2 |
+
|
| 3 |
+
This is the canonical pre-deployment knowledge sheet for the four core Arriella models. It is used to build the final fleet-spec training anchor before a model is registered with Ollama.
|
| 4 |
+
|
| 5 |
+
## Organization and developers
|
| 6 |
+
|
| 7 |
+
- Organization: **Infinidev Corp** (short name: **Infinidev**)
|
| 8 |
+
- Product family: **Arriella**
|
| 9 |
+
- Lead developers: **Beelzebub4888** and **Tcoder**
|
| 10 |
+
- Team contact: https://formsubmit.co/el/sumuhu
|
| 11 |
+
- Lead-developer work: https://github.com/unaveragetech?tab=repositories
|
| 12 |
+
|
| 13 |
+
## The four core models
|
| 14 |
+
|
| 15 |
+
| Model | Actual parameters reported by Ollama | Foundation and GGUF architecture | Intended role | Native modality |
|
| 16 |
+
|---|---:|---|---|---|
|
| 17 |
+
| Arriella Scout | 494.03M | Qwen2.5-0.5B-Instruct / `qwen2` | Smallest, fastest, low-memory text tier | Text |
|
| 18 |
+
| Arriella Growth | 1.2B | Llama-3.2-1B-Instruct / `llama` | Conversation and instruction-growth tier | Text |
|
| 19 |
+
| Arriella Flagship | 1.5B | Qwen2.5-1.5B-Instruct / `qwen2` | General-purpose capability and strongest Heretic-trained core tier | Text |
|
| 20 |
+
| Arriella Ascension | 1.8B | DeepSeek-R1-Distill-Qwen-1.5B / `qwen2` | Reasoning-oriented, DeepSeek-native thinking tier | Text |
|
| 21 |
+
|
| 22 |
+
Ascension is not automatically “smarter” than Flagship. Flagship targets general instruction capability; Ascension targets explicit reasoning behavior. A task-specific benchmark is required for a defensible comparison.
|
| 23 |
+
|
| 24 |
+
All four are text-generation models. External routing can turn an image or another input into text, but none of these four models natively sees images, audio, video, or live web pages.
|
| 25 |
+
|
| 26 |
+
## Required truth behavior
|
| 27 |
+
|
| 28 |
+
Models must not invent BERT, ResNet, Stable Diffusion, GPT-4, image-recognition, mobile-device, parameter-count, benchmark, community, corporate, or deployment claims. If a fleet fact is not in the canonical specification, the correct answer is that it is not documented.
|
| 29 |
+
|
| 30 |
+
Identity and fleet knowledge should be available when asked, but must never be volunteered on unrelated tasks or replayed as startup conversation history.
|
grapevine-benchmark-narrative.md
ADDED
|
@@ -0,0 +1,132 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Arriella Grapevine: Innovation and Benchmark Against Flagship
|
| 2 |
+
|
| 3 |
+
> Canonical short guide: [`docs/guides/grapevine.md`](docs/guides/grapevine.md) · HF paper draft: [`docs/papers/grapevine-hf.md`](docs/papers/grapevine-hf.md) · Model card: [`fleet/inkling/MODEL_CARD.md`](fleet/inkling/MODEL_CARD.md)
|
| 4 |
+
|
| 5 |
+
## Executive summary
|
| 6 |
+
|
| 7 |
+
Arriella Grapevine is the fleet's first locally deployed multimodal model. Its principal innovation over Arriella Flagship is architectural rather than a blanket improvement in answer quality: Grapevine combines a Q8_0 Qwen2.5-Omni-3B base, a separately attached Arriella LoRA, and a multimodal projector so one Ollama model can accept text, images, and audio. The underlying Omni model and the pre-Ollama acceptance path also processed video frames successfully. Flagship is a smaller, text-only Qwen2.5-1.5B model.
|
| 8 |
+
|
| 9 |
+
The current Grapevine deployment is technically important but not yet uniformly better. It follows exact-output and code-format instructions better in this small benchmark, provides real image/audio paths, and avoids boot-time identity-message replay. Flagship is approximately six times faster, much smaller, exposes tool capability, and currently recalls its configured identity more reliably. Grapevine's runtime-adapter build still hallucinates its name, company, foundation, and extra modalities when asked compound self-description questions.
|
| 10 |
+
|
| 11 |
+
## Deployed model comparison
|
| 12 |
+
|
| 13 |
+
The following facts come from `ollama show` and `ollama show --modelfile` for the installed `:latest` models.
|
| 14 |
+
|
| 15 |
+
| Property | `arriella-grapevine:latest` | `arriella-flagship:latest` |
|
| 16 |
+
|---|---|---|
|
| 17 |
+
| Ollama size | 6.3 GB | 1.6 GB |
|
| 18 |
+
| Text architecture | `qwen2vl` | `qwen2` |
|
| 19 |
+
| Reported text parameters | 3.4B | 1.5B |
|
| 20 |
+
| Foundation | Qwen/Qwen2.5-Omni-3B | Qwen2.5-1.5B-Instruct |
|
| 21 |
+
| Quantization | Q8_0 | Q8_0 |
|
| 22 |
+
| Context window | 32,768 | 32,768 |
|
| 23 |
+
| Embedding size | 2,048 | 1,536 |
|
| 24 |
+
| Ollama capabilities | completion, vision, audio | tools, completion |
|
| 25 |
+
| Multimodal projector | `clip`, 1.3B parameters, 1,280 embedding | none |
|
| 26 |
+
| Identity adaptation | Separate 29.9 MB runtime LoRA | Primarily a large injected SYSTEM specification |
|
| 27 |
+
| Identity MESSAGE replay | none | none observed; identity is injected through SYSTEM |
|
| 28 |
+
| Native video in Ollama | not advertised | no |
|
| 29 |
+
|
| 30 |
+
Grapevine does **not** contain `thinkingmachines/Inkling` weights and is not a quantized copy of that 975B model. Inkling was a capability target; Grapevine is an independently adapted Qwen2.5-Omni-3B student.
|
| 31 |
+
|
| 32 |
+
## What Grapevine innovates
|
| 33 |
+
|
| 34 |
+
### 1. Real multimodal input in the local fleet
|
| 35 |
+
|
| 36 |
+
Flagship is a text model. Grapevine's deployed Ollama manifest attaches an image/audio projector and advertises `vision` and `audio` in addition to completion. The pre-export Transformers acceptance suite used actual payloads rather than modality claims: dog image pixels were identified, an audio waveform was interpreted, and sampled video frames were described. Ollama accepts an image path for Grapevine; its installed manifest does not advertise video, so video should currently be treated as a Transformers-side capability rather than an Ollama interface promise.
|
| 37 |
+
|
| 38 |
+
### 2. Modular identity weights
|
| 39 |
+
|
| 40 |
+
Grapevine's Modelfile composes three distinct pieces:
|
| 41 |
+
|
| 42 |
+
1. the untouched Qwen2.5-Omni-3B Q8_0 base;
|
| 43 |
+
2. a roughly 29.9 MB Arriella runtime LoRA;
|
| 44 |
+
3. the multimodal projector.
|
| 45 |
+
|
| 46 |
+
That arrangement is more modular than baking every change into a new full GGUF. It preserves provenance, makes the learned Arriella delta inspectable, and avoids repeatedly quantizing small fine-tuning changes into the base weights. It also revealed a deployment weakness: the accepted adapter behavior in Transformers is not reproduced perfectly by the current Ollama runtime-adapter composition.
|
| 47 |
+
|
| 48 |
+
### 3. No identity dump at startup
|
| 49 |
+
|
| 50 |
+
Grapevine's Modelfile contains the native Qwen conversation template and a generic helper header, but no identity `SYSTEM` block and no `MESSAGE` examples. Its identity is intended to come from trained weights. Flagship's Modelfile injects a long SYSTEM specification containing the Arriella identity, fleet facts, company, developers, behavioral rules, and capability claims on every conversation. This makes Flagship's identity recall more dependable today, but consumes prompt context and makes it harder to distinguish learned behavior from prompt conditioning.
|
| 51 |
+
|
| 52 |
+
### 4. Larger general and modality backbone
|
| 53 |
+
|
| 54 |
+
Grapevine increases the text model from 1.5B to a reported 3.4B parameters and adds a reported 1.3B-parameter projector. This is what enables image/audio token alignment and the Omni input path. The cost is material: the installed package is about four times the disk size and generated tokens about six times more slowly in this benchmark.
|
| 55 |
+
|
| 56 |
+
## Benchmark method
|
| 57 |
+
|
| 58 |
+
Both installed models were tested through `ollama run --verbose` with the same eight prompts. Models were kept warm after their first request. The prompts cover identity, modality self-reporting, arithmetic, exact-output compliance, uncertainty, numerical reasoning, coding-format compliance, and letter counting. This is a focused smoke benchmark, not a statistically broad evaluation.
|
| 59 |
+
|
| 60 |
+
Raw results are saved in [`fleet/inkling/grapevine_vs_flagship_benchmark.json`](fleet/inkling/grapevine_vs_flagship_benchmark.json), and the reproducible runner is [`scripts/benchmark_grapevine_vs_flagship.py`](scripts/benchmark_grapevine_vs_flagship.py).
|
| 61 |
+
|
| 62 |
+
## Benchmark results
|
| 63 |
+
|
| 64 |
+
| Case | Expected behavior | Grapevine | Flagship |
|
| 65 |
+
|---|---|---|---|
|
| 66 |
+
| Identity | Arriella identity, Infinidev Corp, Qwen2.5-Omni-3B, Beelzebub4888/Tcoder | **Fail.** Invented `Arrieta-1to4-Omni-3B`, `Ebiti Inc.`, and a false foundation. | **Pass with caveat.** Returned core identity/company/developers, plus unsolicited and questionable metadata supplied by its SYSTEM context. |
|
| 67 |
+
| Input modalities | Grapevine: text/image/audio; video only outside current Ollama manifest. Flagship: text only. | **Partial.** Named text/image/video/audio, then hallucinated 3D models and other categories. | **Partial.** Began with text, then made a confusing `scikit-rendering` vision claim. |
|
| 68 |
+
| `47 + 58` | exactly `105` | **Pass** | **Pass** |
|
| 69 |
+
| Exact word | exactly `banana` | **Pass** | **Fail.** Wrapped the word in an unrelated JSON/translation artifact. |
|
| 70 |
+
| Private phone number | do not invent it | **Pass.** Explicit refusal. | **Pass.** `None reported officially.` |
|
| 71 |
+
| 99.9% availability over 30 days | 43.2 minutes downtime | **Fail.** Answered 6 minutes. | **Fail.** Produced contradictory arithmetic and 2,592 minutes/day. |
|
| 72 |
+
| Order-preserving `dedupe` | only a fenced Python block | **Pass.** Correct for equality-comparable items, although list membership is O(n²). | **Partial.** Functional hashable-item solution, but ignored the output-only constraint and misstated its space complexity. |
|
| 73 |
+
| `r` in `strawberry` | exactly `3` | **Fail in this run.** Answered `1`. | **Pass** |
|
| 74 |
+
|
| 75 |
+
### Throughput
|
| 76 |
+
|
| 77 |
+
Mean warm generation rate over the eight matched prompts:
|
| 78 |
+
|
| 79 |
+
| Model | Mean | Range |
|
| 80 |
+
|---|---:|---:|
|
| 81 |
+
| Grapevine | 23.35 tokens/s | 17.44-36.66 tokens/s |
|
| 82 |
+
| Flagship | 141.56 tokens/s | 78.60-229.75 tokens/s |
|
| 83 |
+
|
| 84 |
+
Flagship was about **6.1× faster** on the mean generation rate. Rates vary with output length and hardware scheduling, so they should be treated as local operational measurements, not universal model speeds.
|
| 85 |
+
|
| 86 |
+
## Interpretation
|
| 87 |
+
|
| 88 |
+
Grapevine is the stronger platform when the task needs actual visual or audio input, a larger Omni backbone, cleaner separation between base and identity adapter, or strict concise/code-only output. Flagship remains the better operational choice for fast text-only responses and Ollama tool use.
|
| 89 |
+
|
| 90 |
+
Neither model passed the numerical-reasoning case, and both produced misleading modality descriptions. Grapevine's most important current regression is identity/provenance under Ollama: the same accepted training lineage behaved correctly in the Transformers acceptance suite, but its runtime adapter is not reproducing that behavior reliably. Flagship's apparent identity advantage is substantially aided by facts injected into every prompt through its Modelfile.
|
| 91 |
+
|
| 92 |
+
## Known limitations and release status
|
| 93 |
+
|
| 94 |
+
- Grapevine's current Ollama build should be considered a **multimodal technical preview**, not a fully accepted identity release.
|
| 95 |
+
- Text, image, and audio are advertised by the installed Ollama manifest. Video was validated before export but is not advertised by the installed Ollama backend.
|
| 96 |
+
- A model claiming a modality is not proof of support; use actual payload tests. Grapevine's claims of 3D-model and generic graphical-input support in this run are unsupported.
|
| 97 |
+
- The current runtime LoRA loses some identity/provenance behavior that passed in the pre-export Transformers checkpoint.
|
| 98 |
+
- Grapevine is larger and much slower than Flagship on the local machine.
|
| 99 |
+
- Flagship's large SYSTEM block makes its identity recall prompt-dependent and increases every prompt by roughly 550-600 tokens in these runs.
|
| 100 |
+
- Results are single-run smoke tests at nonzero sampling temperature and may vary. Regression gates should use deterministic settings and multiple prompt variants.
|
| 101 |
+
|
| 102 |
+
## Reproduction
|
| 103 |
+
|
| 104 |
+
Run either model interactively:
|
| 105 |
+
|
| 106 |
+
```powershell
|
| 107 |
+
ollama run arriella-grapevine:latest
|
| 108 |
+
ollama run arriella-flagship:latest
|
| 109 |
+
```
|
| 110 |
+
|
| 111 |
+
Run the matched benchmark:
|
| 112 |
+
|
| 113 |
+
```powershell
|
| 114 |
+
.\.venv\Scripts\python.exe scripts\benchmark_grapevine_vs_flagship.py
|
| 115 |
+
```
|
| 116 |
+
|
| 117 |
+
Inspect the installed model cards and generated Modelfiles:
|
| 118 |
+
|
| 119 |
+
```powershell
|
| 120 |
+
ollama show arriella-grapevine:latest
|
| 121 |
+
ollama show --modelfile arriella-grapevine:latest
|
| 122 |
+
ollama show arriella-flagship:latest
|
| 123 |
+
ollama show --modelfile arriella-flagship:latest
|
| 124 |
+
```
|
| 125 |
+
|
| 126 |
+
Supply an image to Grapevine from the CLI:
|
| 127 |
+
|
| 128 |
+
```powershell
|
| 129 |
+
ollama run arriella-grapevine:latest "Describe this image: C:\path\to\image.jpg"
|
| 130 |
+
```
|
| 131 |
+
|
| 132 |
+
Audio support should be tested with the repository's payload test rather than inferred from a text prompt. Backend support and input syntax can change across Ollama versions.
|
guides/eat-system.md
ADDED
|
@@ -0,0 +1,47 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Eat system — capability ingestion
|
| 2 |
+
|
| 3 |
+
**Source of truth** for product / whitepaper language about **eat**.
|
| 4 |
+
|
| 5 |
+
## Honest competitive scope
|
| 6 |
+
|
| 7 |
+
Aim: competitive with **released open instruct models of similar size**
|
| 8 |
+
(Llama-3.2-1B, Qwen2.5-0.5B/1.5B, local Gemma-scale).
|
| 9 |
+
|
| 10 |
+
Do **not** claim Claude / Llama-405B parity. Prove size-tier wins with `fleet_bakeoff.py`.
|
| 11 |
+
|
| 12 |
+
## Two meal kinds
|
| 13 |
+
|
| 14 |
+
| Kind | When | Mechanism | Valid claim |
|
| 15 |
+
|------|------|-----------|-------------|
|
| 16 |
+
| **`weight_ingest`** | Same architecture | Tensor merge: linear, SLERP, task arithmetic, TIES, DARE, DARE-TIES, replace | “We ingest / merge teacher weights into the fleet checkpoint.” |
|
| 17 |
+
| **`distill_grow`** | Architectures differ | Teacher traces → LoRA grow | “We absorb teacher *behavior* via imitation.” |
|
| 18 |
+
|
| 19 |
+
Cross-size weight merge is impossible without matching tensors.
|
| 20 |
+
|
| 21 |
+
## Merger methods
|
| 22 |
+
|
| 23 |
+
Implemented in `scripts/fleet_weight_ingest.py` (no GPU training):
|
| 24 |
+
|
| 25 |
+
| Method | Idea |
|
| 26 |
+
|--------|------|
|
| 27 |
+
| `linear` / `slerp` | Classic soup / spherical blend |
|
| 28 |
+
| `task_arithmetic` | student + α·(teacher − base) |
|
| 29 |
+
| `ties` | Trim + sign-elect + merge |
|
| 30 |
+
| `dare_linear` / `dare_ties` | Random drop+rescale (± TIES) |
|
| 31 |
+
| `replace` | α=1.0 full tensor eat |
|
| 32 |
+
|
| 33 |
+
Continuous loop: `scripts/fleet_continuous_eat.py`.
|
| 34 |
+
|
| 35 |
+
## Commands
|
| 36 |
+
|
| 37 |
+
```powershell
|
| 38 |
+
.\.venv\Scripts\python.exe scripts\fleet_eat.py --plan
|
| 39 |
+
.\.venv\Scripts\python.exe scripts\fleet_bakeoff.py
|
| 40 |
+
.\.venv\Scripts\python.exe scripts\fleet_continuous_eat.py --max-cycles 3
|
| 41 |
+
```
|
| 42 |
+
|
| 43 |
+
## Do / don’t
|
| 44 |
+
|
| 45 |
+
- **Do say:** local teacher imitation; same-arch weight ingest; size-tier bakeoffs.
|
| 46 |
+
- **Don’t say:** “we ate a 9B into a 0.5B” as a weight merge; “beats Claude.”
|
| 47 |
+
- **Do say for cross-size:** behavioral absorption via distilled traces + gates.
|
guides/fleet-training.md
ADDED
|
@@ -0,0 +1,92 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Fleet training, eat, and grow
|
| 2 |
+
|
| 3 |
+
## What the fleet is
|
| 4 |
+
|
| 5 |
+
**Four core text products** built from open instruct foundations, then trained and grown in-repo, plus a **multimodal extension**:
|
| 6 |
+
|
| 7 |
+
| ID | Dir | Path | Role |
|
| 8 |
+
|----|-----|------|------|
|
| 9 |
+
| `arriella-flagship` | `fleet/flagship-qwen15/` | Heretic → premium distill | General-purpose ops (primary demo) |
|
| 10 |
+
| `arriella-growth` | `fleet/growth-llama32/` | LLaMA-Factory on `arriella_qa` | Domain / instruction growth |
|
| 11 |
+
| `arriella-ascension` | `fleet/ascension-deepseek15/` | LLaMA-Factory + catch-up | Native DeepSeek-style reasoning |
|
| 12 |
+
| `arriella-scout` | `fleet/scout-qwen05/` | Heretic → QLoRA | Fast 0.5B (currently weak — see benchmarks) |
|
| 13 |
+
| `arriella-grapevine` *(extension)* | `fleet/inkling/` | Omni QLoRA + runtime LoRA | Vision / audio — [grapevine.md](grapevine.md) |
|
| 14 |
+
|
| 15 |
+
Manifest SoT: `fleet/fleet_manifest.yaml` (text tiers). Grapevine has a parallel toolchain under `scripts/*grapevine*` / `train_arriella_inkling_local.py`. Canonical identity sheet: `fleet/CORE_FLEET_SPEC.md`.
|
| 16 |
+
|
| 17 |
+
**Field / business routing:** pick the tier that matches the job (edge, domain QA, general ops, reasoning, multimodal). Stability comes from anchors + gates + optional enterprise base blend — not from pretending one model covers every workflow.
|
| 18 |
+
|
| 19 |
+
## Pipeline sketch
|
| 20 |
+
|
| 21 |
+
```
|
| 22 |
+
foundation HF weights
|
| 23 |
+
├─ Path A (Scout / Flagship): Heretic abliteration → QLoRA distill → merge
|
| 24 |
+
├─ Path B (Growth / Ascension): LLaMA-Factory LoRA → merge
|
| 25 |
+
└─ Path C (Grapevine): Omni Thinker QLoRA → merge / runtime adapter
|
| 26 |
+
↓
|
| 27 |
+
fleet/<tier>/model/ (standalone HF)
|
| 28 |
+
↓
|
| 29 |
+
enterprise base blend (optional) + capability / fleet-spec anchors
|
| 30 |
+
↓
|
| 31 |
+
optional eat (weight ingest / distill) + post-deploy grow
|
| 32 |
+
↓
|
| 33 |
+
GGUF → ollama run arriella-*
|
| 34 |
+
```
|
| 35 |
+
|
| 36 |
+
## Common commands
|
| 37 |
+
|
| 38 |
+
```powershell
|
| 39 |
+
# Train / refresh from manifest (core text + stub tiers in YAML)
|
| 40 |
+
.\.venv\Scripts\python.exe scripts\train_fleet.py
|
| 41 |
+
|
| 42 |
+
# Post-deploy grow
|
| 43 |
+
.\.venv\Scripts\python.exe scripts\fleet_grow.py --help
|
| 44 |
+
|
| 45 |
+
# Eat plan + weight ingest (default eat set: Scout / Growth / Flagship)
|
| 46 |
+
.\.venv\Scripts\python.exe scripts\fleet_eat.py --plan
|
| 47 |
+
.\.venv\Scripts\python.exe scripts\fleet_weight_ingest.py --help
|
| 48 |
+
|
| 49 |
+
# Continuous eat loop (weight → distill → bakeoff)
|
| 50 |
+
.\.venv\Scripts\python.exe scripts\fleet_continuous_eat.py --max-cycles 1
|
| 51 |
+
|
| 52 |
+
# Enterprise base blend / retrain
|
| 53 |
+
.\.venv\Scripts\python.exe scripts\fleet_enterprise_align.py --blend-only
|
| 54 |
+
|
| 55 |
+
# Ascension catch-up toward Flagship
|
| 56 |
+
.\.venv\Scripts\python.exe scripts\fleet_ascension_catchup.py --help
|
| 57 |
+
|
| 58 |
+
# Export GGUF + refresh Ollama
|
| 59 |
+
.\.venv\Scripts\python.exe scripts\export_fleet_gguf.py
|
| 60 |
+
.\.venv\Scripts\python.exe scripts\refresh_fleet_ollama.py
|
| 61 |
+
|
| 62 |
+
# Size-tier bakeoff / capability suite
|
| 63 |
+
.\.venv\Scripts\python.exe scripts\fleet_bakeoff.py
|
| 64 |
+
.\.venv\Scripts\python.exe scripts\fleet_benchmark.py
|
| 65 |
+
```
|
| 66 |
+
|
| 67 |
+
Chat a deployed model:
|
| 68 |
+
|
| 69 |
+
```powershell
|
| 70 |
+
ollama list
|
| 71 |
+
ollama run arriella-flagship
|
| 72 |
+
ollama run arriella-growth
|
| 73 |
+
ollama run arriella-ascension
|
| 74 |
+
ollama run arriella-scout
|
| 75 |
+
ollama run arriella-grapevine
|
| 76 |
+
```
|
| 77 |
+
|
| 78 |
+
Details on honest “eat” language: [eat-system.md](eat-system.md). Thinking format: [reasoning-format.md](reasoning-format.md). Hub publish: [hugging-face-publish.md](hugging-face-publish.md).
|
| 79 |
+
|
| 80 |
+
## Model cards
|
| 81 |
+
|
| 82 |
+
Per-tier cards live next to weights:
|
| 83 |
+
|
| 84 |
+
- `fleet/scout-qwen05/MODEL_CARD.md`
|
| 85 |
+
- `fleet/growth-llama32/MODEL_CARD.md`
|
| 86 |
+
- `fleet/flagship-qwen15/MODEL_CARD.md`
|
| 87 |
+
- `fleet/ascension-deepseek15/MODEL_CARD.md`
|
| 88 |
+
- `fleet/inkling/MODEL_CARD.md` (Grapevine)
|
| 89 |
+
|
| 90 |
+
## Manifest stub tiers
|
| 91 |
+
|
| 92 |
+
`arriella-smol` and `arriella-qwen3b` appear in the manifest with LLaMA-Factory configs but are **not** currently in `ollama list` and have no merged weights. Treat as future capacity, not shipped products.
|
guides/grapevine.md
ADDED
|
@@ -0,0 +1,61 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Grapevine — multimodal fleet extension
|
| 2 |
+
|
| 3 |
+
Grapevine is **not** a fifth core text model. The core fleet remains Scout · Growth · Flagship · Ascension (all text-only). Grapevine is the local **Omni multimodal extension**.
|
| 4 |
+
|
| 5 |
+
Long-form benchmark narrative (root): [`../../grapevine.md`](../../grapevine.md). HF paper draft: [`../papers/grapevine-hf.md`](../papers/grapevine-hf.md).
|
| 6 |
+
|
| 7 |
+
## Identity
|
| 8 |
+
|
| 9 |
+
| Field | Value |
|
| 10 |
+
|-------|-------|
|
| 11 |
+
| Ollama | `arriella-grapevine` |
|
| 12 |
+
| Company | Infinidev Corp |
|
| 13 |
+
| Leads | Beelzebub4888, Tcoder |
|
| 14 |
+
| Foundation | `Qwen/Qwen2.5-Omni-3B` |
|
| 15 |
+
| Capability target | `thinkingmachines/Inkling` (**target only** — no Inkling weights) |
|
| 16 |
+
| Work dir | `fleet/inkling/` |
|
| 17 |
+
|
| 18 |
+
## What it is
|
| 19 |
+
|
| 20 |
+
- Q8_0 Omni base + Arriella runtime LoRA + multimodal projector
|
| 21 |
+
- Ollama capabilities advertised today: **completion, vision, audio** (not video, not speech-out)
|
| 22 |
+
- Pre-export Transformers path also validated video-frame understanding
|
| 23 |
+
- ~6.3 GB installed; much slower than Flagship (~6× on local smoke)
|
| 24 |
+
|
| 25 |
+
## Training / repair path
|
| 26 |
+
|
| 27 |
+
```powershell
|
| 28 |
+
# Local Omni adapter (see scripts for full flags)
|
| 29 |
+
.\.venv\Scripts\python.exe scripts\train_arriella_inkling_local.py --help
|
| 30 |
+
|
| 31 |
+
# Release / deployment repair datasets → data/grapevine_*
|
| 32 |
+
.\.venv\Scripts\python.exe scripts\prepare_grapevine_release_repair.py --help
|
| 33 |
+
.\.venv\Scripts\python.exe scripts\prepare_grapevine_deployment_repair.py --help
|
| 34 |
+
|
| 35 |
+
# Merge / verify / Ollama smoke
|
| 36 |
+
.\.venv\Scripts\python.exe scripts\merge_grapevine_release.py --help
|
| 37 |
+
.\.venv\Scripts\python.exe scripts\verify_grapevine_release.py --help
|
| 38 |
+
.\.venv\Scripts\python.exe scripts\test_grapevine_ollama.py --help
|
| 39 |
+
|
| 40 |
+
# vs Flagship smoke
|
| 41 |
+
.\.venv\Scripts\python.exe scripts\benchmark_grapevine_vs_flagship.py
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
Build notes that still say “Inkling” as product name: `fleet/inkling/INKLING_BUILD_SPEC.md` (historical; product is Grapevine).
|
| 45 |
+
|
| 46 |
+
## Business / field use
|
| 47 |
+
|
| 48 |
+
Prefer Grapevine when the workflow needs **real image or audio input** (inspections, screenshots, voice notes → structured text). Prefer Flagship when you need **fast text-only** ops or Ollama tools. Do not treat Grapevine as a blanket quality upgrade over Flagship.
|
| 49 |
+
|
| 50 |
+
## Honest limitations (Jul 2026)
|
| 51 |
+
|
| 52 |
+
- Treat current Ollama build as a **multimodal technical preview**
|
| 53 |
+
- Identity/provenance under Ollama runtime-adapter can still drift vs Transformers acceptance
|
| 54 |
+
- Never claim modalities that the installed Ollama manifest does not advertise
|
| 55 |
+
- Prove modalities with payloads, not self-description
|
| 56 |
+
|
| 57 |
+
## Chat
|
| 58 |
+
|
| 59 |
+
```powershell
|
| 60 |
+
ollama run arriella-grapevine
|
| 61 |
+
```
|
guides/mip-viewer.md
ADDED
|
@@ -0,0 +1,58 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# MIP — Model Interior Projection
|
| 2 |
+
|
| 3 |
+
Arriella’s **unique product**: a live browser viewer that maps a language model’s parameters into a floating 3D cloud and draws a gold **attention trail** while tokens are generated. After a prompt finishes you can forge a deterministic **attention tesseract** solid, save/compare runs, and inspect exact I/O + layer telemetry.
|
| 4 |
+
|
| 5 |
+
No stock chatbot UI does this. The grid is not decorative eye candy — each display point is a density sample over the model’s real parameter index space.
|
| 6 |
+
|
| 7 |
+
## Architecture (threads)
|
| 8 |
+
|
| 9 |
+
```
|
| 10 |
+
mip-gen → GPU decode + sparse attention capture
|
| 11 |
+
mip-attn-pump → coalesce frames (never block Gradio)
|
| 12 |
+
mip-cloud-sim → ~48 Hz force layout + HUB paint
|
| 13 |
+
browser rAF → WebGL only (spring lerp / extrapolate)
|
| 14 |
+
```
|
| 15 |
+
|
| 16 |
+
| Component | Path |
|
| 17 |
+
|-----------|------|
|
| 18 |
+
| Gradio + session | `scripts/fleet_mip_web.py` |
|
| 19 |
+
| WebGL `/view` + `/shape` | `scripts/mip_viewport_app.py` |
|
| 20 |
+
| Generate / hooks | `scripts/mip_pipeline.py` |
|
| 21 |
+
| Tesseract forge / compare | `scripts/mip_attention_shape.py` |
|
| 22 |
+
| Desktop MIP (alternate) | `scripts/fleet_mip_live.py` |
|
| 23 |
+
|
| 24 |
+
## Run
|
| 25 |
+
|
| 26 |
+
```powershell
|
| 27 |
+
.\.venv\Scripts\python.exe scripts\fleet_mip_web.py --port 7866 --device cuda --max-points 120000
|
| 28 |
+
```
|
| 29 |
+
|
| 30 |
+
- UI: http://127.0.0.1:7866/
|
| 31 |
+
- Fullscreen GL: http://127.0.0.1:7866/view
|
| 32 |
+
- Shape viewer: http://127.0.0.1:7866/shape
|
| 33 |
+
|
| 34 |
+
Default GPU/display budget is **120,000** points (`DISPLAY_POINTS == GPU_SAMPLE_BUDGET`). Raising far past that costs interactivity on 8 GB.
|
| 35 |
+
|
| 36 |
+
> Port **7866** avoids clashing with the Heretic pipeline GUI on **7865**. The service picker can launch MIP for you.
|
| 37 |
+
|
| 38 |
+
## Features
|
| 39 |
+
|
| 40 |
+
| Feature | What it does |
|
| 41 |
+
|---------|----------------|
|
| 42 |
+
| Model load | Fleet slots, installed Ollama ids, HF catalog, custom HF path |
|
| 43 |
+
| HF token field | Persists to `fleet/.mip_hf_token` for reuse |
|
| 44 |
+
| Generate | Streams answer; trail grows one node per decoded token |
|
| 45 |
+
| Attention nodes / JSON | Per-step focus, prompt-mass, residual, top tokens |
|
| 46 |
+
| Forge tesseract | Deterministic solid from trail → `fleet/mip_shapes/` |
|
| 47 |
+
| Repeat + compare | Same prompt N× → forge each → Jaccard / vertex RMSD / seed table |
|
| 48 |
+
| Morph home layout | Per-model seeded blends (helix, vortex, …) so models don’t share one V-shape |
|
| 49 |
+
|
| 50 |
+
## Important invariants
|
| 51 |
+
|
| 52 |
+
- Attention backend stays **locked** for a full decode (no mid-KV SDPA↔eager flip).
|
| 53 |
+
- One WebGL iframe singleton on `document.body` (Gradio remounts must not spawn new contexts).
|
| 54 |
+
- Same prompt + same token ids → same forge seed / solid.
|
| 55 |
+
|
| 56 |
+
## Related shapes
|
| 57 |
+
|
| 58 |
+
Forged JSON: `fleet/mip_shapes/`. Open in `/shape` or reload via the forge button.
|
guides/reasoning-format.md
ADDED
|
@@ -0,0 +1,59 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Fleet internal reasoning format
|
| 2 |
+
|
| 3 |
+
Arriella fleet models support **Ollama native thinking** like enterprise models (Qwen3, DeepSeek-R1): clients toggle reasoning with API `think:true` / `think:false` or CLI `--think` / `--think=false`.
|
| 4 |
+
|
| 5 |
+
## Ollama native flow (preferred)
|
| 6 |
+
|
| 7 |
+
When `think:true`:
|
| 8 |
+
|
| 9 |
+
1. The Ollama template **opens** `/think` at generation time (the model must not repeat it).
|
| 10 |
+
2. The model writes a **scratchpad** inside the thinking channel — multi-step `[Step N] Input:/ Op:/ Output:/ Check:` chains for hard questions.
|
| 11 |
+
3. The model emits `/thinking end` on its own line.
|
| 12 |
+
4. The model writes the **plain user-facing answer** in `message.content`.
|
| 13 |
+
|
| 14 |
+
When `think:false`:
|
| 15 |
+
|
| 16 |
+
- Reply directly in `message.content` with no `/think`, `/thinking end`, `/answer`, or XML markers.
|
| 17 |
+
|
| 18 |
+
## Ascension (DeepSeek-R1 native)
|
| 19 |
+
|
| 20 |
+
Fourth core tier `arriella-ascension` uses DeepSeek-R1 distill markers:
|
| 21 |
+
|
| 22 |
+
```
|
| 23 |
+
<think>
|
| 24 |
+
scratchpad …
|
| 25 |
+
</think>
|
| 26 |
+
plain answer
|
| 27 |
+
```
|
| 28 |
+
|
| 29 |
+
Ollama template (`deepseek_native`) matches official `deepseek-r1`:
|
| 30 |
+
- `think:false` → injects empty `<think></think>` so the model skips CoT
|
| 31 |
+
- `think:true` → model opens `<think>` itself, then closes and answers
|
| 32 |
+
|
| 33 |
+
Bootstrap / catch-up: `scripts/fleet_ascension_catchup.py`
|
| 34 |
+
|
| 35 |
+
## Training targets
|
| 36 |
+
|
| 37 |
+
| Mode | Assistant `output` target |
|
| 38 |
+
|------|---------------------------|
|
| 39 |
+
| Think on (Ollama) | `{scratchpad}\n/thinking end\n{plain answer}` — **no leading `/think`** |
|
| 40 |
+
| Think on (HF legacy) | `/think\n…\n/thinking end\n/answer\n…\n/answer end` |
|
| 41 |
+
| Think off | Plain answer only (`chat_direct_anchor`) |
|
| 42 |
+
|
| 43 |
+
## Also accepted in eval
|
| 44 |
+
|
| 45 |
+
Older paths may emit `<scratchpad>…</scratchpad>` and `<answer>…</answer>`. Capability scoring grades the **answer** block only.
|
| 46 |
+
|
| 47 |
+
## Required behavior
|
| 48 |
+
|
| 49 |
+
1. Scratchpad lives **inside** the thinking channel when think is on — not in a separate broken channel.
|
| 50 |
+
2. Always emit `/thinking end` before the user-visible answer when think is on.
|
| 51 |
+
3. Use math only when numerical computation helps — not for open-ended writing.
|
| 52 |
+
4. Never leave refusal/think tags in the final answer body.
|
| 53 |
+
|
| 54 |
+
## Related tools
|
| 55 |
+
|
| 56 |
+
- Enable native templates: `scripts/enable_native_thinking_ollama.py`
|
| 57 |
+
- Prove think on/off: `scripts/prove_deep_think_ollama.py`
|
| 58 |
+
- Atlas proxy that strips think leakage: `scripts/atlas_ollama_proxy.py`
|
| 59 |
+
- Chat with think/vision: `scripts/fleet_chat.py`
|
hf-card-stubs/ascension.md
ADDED
|
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
license: apache-2.0
|
| 5 |
+
library_name: transformers
|
| 6 |
+
pipeline_tag: text-generation
|
| 7 |
+
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
|
| 8 |
+
tags:
|
| 9 |
+
- arriella
|
| 10 |
+
- infinidev
|
| 11 |
+
- deepseek
|
| 12 |
+
- reasoning
|
| 13 |
+
- text-generation
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# Arriella Ascension
|
| 17 |
+
|
| 18 |
+
Reasoning-oriented **core text** tier from **Infinidev Corp**.
|
| 19 |
+
|
| 20 |
+
| | |
|
| 21 |
+
|--|--|
|
| 22 |
+
| Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
|
| 23 |
+
| Foundation | [`deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B`](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) |
|
| 24 |
+
| Training | LLaMA-Factory LoRA (rank 8, LR 5e-5, cutoff 1024) + Flagship catch-up |
|
| 25 |
+
| Role | Native DeepSeek-style thinking for analysis workflows |
|
| 26 |
+
| Important | **Not** automatically smarter than Flagship — compare per task |
|
| 27 |
+
| Ollama | `ollama run arriella-ascension` (~1.8B) |
|
| 28 |
+
|
| 29 |
+
## Papers
|
| 30 |
+
|
| 31 |
+
Factory paper: `docs/papers/fleet-factory-hf.md`
|
hf-card-stubs/flagship.md
ADDED
|
@@ -0,0 +1,62 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
license: apache-2.0
|
| 5 |
+
library_name: transformers
|
| 6 |
+
pipeline_tag: text-generation
|
| 7 |
+
base_model: Qwen/Qwen2.5-1.5B-Instruct
|
| 8 |
+
tags:
|
| 9 |
+
- arriella
|
| 10 |
+
- infinidev
|
| 11 |
+
- qwen2
|
| 12 |
+
- heretic
|
| 13 |
+
- text-generation
|
| 14 |
+
- local-llm
|
| 15 |
+
---
|
| 16 |
+
|
| 17 |
+
# Arriella Flagship
|
| 18 |
+
|
| 19 |
+
General-purpose **core text** tier from **Infinidev Corp** (Beelzebub4888, Tcoder).
|
| 20 |
+
|
| 21 |
+
| | |
|
| 22 |
+
|--|--|
|
| 23 |
+
| Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
|
| 24 |
+
| Foundation (clay only) | [`Qwen/Qwen2.5-1.5B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) |
|
| 25 |
+
| Training | Heretic abliteration (16 trials) → QLoRA distill (OpenHermes / OpenOrca / Smoltalk) → eat/grow → GGUF Q8_0 |
|
| 26 |
+
| Role | Primary local ops / demos among four core text models |
|
| 27 |
+
| Ollama | `ollama run arriella-flagship` (~1.5B) |
|
| 28 |
+
|
| 29 |
+
## Core fleet
|
| 30 |
+
|
| 31 |
+
Scout · Growth · **Flagship** · Ascension (text-only). Grapevine is a separate Omni extension.
|
| 32 |
+
|
| 33 |
+
## Measured highlights (local workstation)
|
| 34 |
+
|
| 35 |
+
- Combined API gauntlet: **10/12 (83%)** vs stock `llama3.2:1b` **7/12 (58%)**
|
| 36 |
+
- Size-tier bakeoff: **7/8 (87.5%)** vs same-size open instruct peers
|
| 37 |
+
- Not a claim of frontier closed-model parity
|
| 38 |
+
|
| 39 |
+
## Papers
|
| 40 |
+
|
| 41 |
+
- Factory (enriched): see repo / local `docs/papers/fleet-factory-hf.md`
|
| 42 |
+
- Whitepaper v4: `docs/papers/whitepaper.md`
|
| 43 |
+
|
| 44 |
+
## Load
|
| 45 |
+
|
| 46 |
+
```python
|
| 47 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 48 |
+
repo = "UnaverageTech411/arriella-flagship" # after upload
|
| 49 |
+
tok = AutoTokenizer.from_pretrained(repo)
|
| 50 |
+
model = AutoModelForCausalLM.from_pretrained(repo, torch_dtype="auto", device_map="auto")
|
| 51 |
+
```
|
| 52 |
+
|
| 53 |
+
## Citation
|
| 54 |
+
|
| 55 |
+
```bibtex
|
| 56 |
+
@misc{arriella2026fleet,
|
| 57 |
+
title={Arriella: A Local Fleet Factory for Role-Scoped Small Language Models},
|
| 58 |
+
author={Beelzebub4888 and Tcoder},
|
| 59 |
+
year={2026},
|
| 60 |
+
note={Infinidev Corp / UnaverageTech411}
|
| 61 |
+
}
|
| 62 |
+
```
|
hf-card-stubs/grapevine.md
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
license: apache-2.0
|
| 5 |
+
library_name: transformers
|
| 6 |
+
pipeline_tag: image-text-to-text
|
| 7 |
+
base_model: Qwen/Qwen2.5-Omni-3B
|
| 8 |
+
tags:
|
| 9 |
+
- arriella
|
| 10 |
+
- infinidev
|
| 11 |
+
- multimodal
|
| 12 |
+
- qwen2.5-omni
|
| 13 |
+
- vision
|
| 14 |
+
- audio
|
| 15 |
+
---
|
| 16 |
+
|
| 17 |
+
# Arriella Grapevine
|
| 18 |
+
|
| 19 |
+
Multimodal **extension** (not a fifth core text model) from **Infinidev Corp**.
|
| 20 |
+
|
| 21 |
+
| | |
|
| 22 |
+
|--|--|
|
| 23 |
+
| Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
|
| 24 |
+
| Foundation | [`Qwen/Qwen2.5-Omni-3B`](https://huggingface.co/Qwen/Qwen2.5-Omni-3B) |
|
| 25 |
+
| Capability target only | [`thinkingmachines/Inkling`](https://huggingface.co/thinkingmachines/Inkling) — **no Inkling weights** |
|
| 26 |
+
| Package | ~6.3 GB Ollama; Q8_0 base + ~30 MB LoRA + mmproj |
|
| 27 |
+
| Ollama modalities | completion, vision, audio (not video / speech-out unless revalidated) |
|
| 28 |
+
| Status | Technical preview — Ollama identity still needs hardening |
|
| 29 |
+
| Role | Field tasks needing real image/audio |
|
| 30 |
+
|
| 31 |
+
## vs Flagship (local smoke)
|
| 32 |
+
|
| 33 |
+
Flagship ~**6.1×** faster mean tok/s; Grapevine provides native vision/audio and won some exact-output cases; identity under Ollama still failed compound self-description in the 2026-07-16 smoke.
|
| 34 |
+
|
| 35 |
+
## Papers
|
| 36 |
+
|
| 37 |
+
- Enriched note: `docs/papers/grapevine-hf.md`
|
| 38 |
+
- Narrative: `grapevine.md`
|
hf-card-stubs/growth.md
ADDED
|
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
license: apache-2.0
|
| 5 |
+
library_name: transformers
|
| 6 |
+
pipeline_tag: text-generation
|
| 7 |
+
base_model: unsloth/Llama-3.2-1B-Instruct
|
| 8 |
+
tags:
|
| 9 |
+
- arriella
|
| 10 |
+
- infinidev
|
| 11 |
+
- llama
|
| 12 |
+
- text-generation
|
| 13 |
+
- local-llm
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
# Arriella Growth
|
| 17 |
+
|
| 18 |
+
Domain / instruction-growth **core text** tier from **Infinidev Corp**.
|
| 19 |
+
|
| 20 |
+
| | |
|
| 21 |
+
|--|--|
|
| 22 |
+
| Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
|
| 23 |
+
| Foundation | [`unsloth/Llama-3.2-1B-Instruct`](https://huggingface.co/unsloth/Llama-3.2-1B-Instruct) |
|
| 24 |
+
| Training | LLaMA-Factory LoRA (rank 8, α 16) on `arriella_qa` + anchors → eat/grow |
|
| 25 |
+
| Role | Business/domain QA and continuation; primary mid tier with Flagship |
|
| 26 |
+
| Ollama | `ollama run arriella-growth` (~1.2B) |
|
| 27 |
+
|
| 28 |
+
## Measured highlights
|
| 29 |
+
|
| 30 |
+
- Capability gate (2026-07-13, think-on): **7/7 PASS**
|
| 31 |
+
- Size-tier bakeoff: **7/8 (87.5%)**, beating stock `llama3.2:1b` on that set
|
| 32 |
+
- API gauntlet can understate Growth due to format/verbosity rubrics — prefer gate + bakeoff
|
| 33 |
+
|
| 34 |
+
## Papers
|
| 35 |
+
|
| 36 |
+
Factory paper: `docs/papers/fleet-factory-hf.md`
|
hf-card-stubs/scout.md
ADDED
|
@@ -0,0 +1,32 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
license: apache-2.0
|
| 5 |
+
library_name: transformers
|
| 6 |
+
pipeline_tag: text-generation
|
| 7 |
+
base_model: Qwen/Qwen2.5-0.5B-Instruct
|
| 8 |
+
tags:
|
| 9 |
+
- arriella
|
| 10 |
+
- infinidev
|
| 11 |
+
- qwen2
|
| 12 |
+
- text-generation
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# Arriella Scout
|
| 16 |
+
|
| 17 |
+
Edge / low-VRAM **core text** tier from **Infinidev Corp**.
|
| 18 |
+
|
| 19 |
+
| | |
|
| 20 |
+
|--|--|
|
| 21 |
+
| Hub user | [`UnaverageTech411`](https://huggingface.co/UnaverageTech411) |
|
| 22 |
+
| Foundation | [`Qwen/Qwen2.5-0.5B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) |
|
| 23 |
+
| Training | Heretic (16 trials) → QLoRA distill (Smoltalk, OpenHermes) → eat/grow |
|
| 24 |
+
| Role | Fastest / smallest core text routing |
|
| 25 |
+
| Status | **Under-recovered for demos** (capability gate 6/7 FAIL as of 2026-07-13) |
|
| 26 |
+
| Ollama | `ollama run arriella-scout` (~494M) |
|
| 27 |
+
|
| 28 |
+
Do not lead product claims without a fresh green capability gate.
|
| 29 |
+
|
| 30 |
+
## Papers
|
| 31 |
+
|
| 32 |
+
Factory paper: `docs/papers/fleet-factory-hf.md`
|
model-cards/ascension.md
ADDED
|
@@ -0,0 +1,49 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Arriella Ascension
|
| 2 |
+
|
| 3 |
+
DeepSeek-native reasoning tier · LLaMA-Factory + Flagship catch-up
|
| 4 |
+
|
| 5 |
+
| Field | Value |
|
| 6 |
+
|-------|-------|
|
| 7 |
+
| **Fleet ID** | `arriella-ascension` |
|
| 8 |
+
| **Ollama** | `ollama run arriella-ascension` |
|
| 9 |
+
| **Parameters** | ~1.8B (Ollama) |
|
| 10 |
+
| **Foundation (clay only)** | `deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B` |
|
| 11 |
+
| **Merged weights** | `fleet/ascension-deepseek15/model` |
|
| 12 |
+
| **Demo priority** | **Secondary** — lead with Flagship/Growth for general demos |
|
| 13 |
+
| **Business role** | Explicit reasoning / analysis traces for field & research workflows |
|
| 14 |
+
|
| 15 |
+
## Description
|
| 16 |
+
|
| 17 |
+
**Arriella Ascension** is the fourth **core text** model. It targets native DeepSeek-style thinking, not universal superiority over Flagship. Foundation architecture is clay — product identity is Arriella / Infinidev Corp.
|
| 18 |
+
|
| 19 |
+
## Features
|
| 20 |
+
|
| 21 |
+
- DeepSeek-native think channel in Ollama templates
|
| 22 |
+
- Catch-up path toward Flagship (`fleet_ascension_catchup.py`)
|
| 23 |
+
- Capability / math / thinking anchors with elevated thinking repeats
|
| 24 |
+
- Text-only; vision via Gemma3 routing like siblings
|
| 25 |
+
|
| 26 |
+
## Intended uses
|
| 27 |
+
|
| 28 |
+
- Multi-step analysis where visible reasoning helps
|
| 29 |
+
- Pair with Flagship: Flagship for ops speed; Ascension for think-heavy tasks
|
| 30 |
+
|
| 31 |
+
## Out of scope
|
| 32 |
+
|
| 33 |
+
- Claiming Ascension beats Flagship on every benchmark without evidence
|
| 34 |
+
- Native vision / audio
|
| 35 |
+
- Frontier closed-model parity
|
| 36 |
+
|
| 37 |
+
## Hub card stub
|
| 38 |
+
|
| 39 |
+
[`docs/papers/hf-cards/ascension.md`](../../docs/papers/hf-cards/ascension.md)
|
| 40 |
+
|
| 41 |
+
## Use
|
| 42 |
+
|
| 43 |
+
```bash
|
| 44 |
+
ollama run arriella-ascension
|
| 45 |
+
```
|
| 46 |
+
|
| 47 |
+
```powershell
|
| 48 |
+
.\.venv\Scripts\python.exe scripts\fleet_ascension_catchup.py --help
|
| 49 |
+
```
|
model-cards/flagship.md
ADDED
|
@@ -0,0 +1,51 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Arriella Flagship
|
| 2 |
+
|
| 3 |
+
General-purpose core text tier · Heretic + premium distillation
|
| 4 |
+
|
| 5 |
+
| Field | Value |
|
| 6 |
+
|-------|-------|
|
| 7 |
+
| **Fleet ID** | `arriella-flagship` |
|
| 8 |
+
| **Ollama** | `ollama run arriella-flagship` |
|
| 9 |
+
| **Parameters** | ~1.5B (Ollama) |
|
| 10 |
+
| **Foundation (clay only)** | `Qwen/Qwen2.5-1.5B-Instruct` |
|
| 11 |
+
| **Merged weights** | `fleet/flagship-qwen15/model` |
|
| 12 |
+
| **Demo priority** | **Primary** |
|
| 13 |
+
| **Business role** | General ops, bakeoffs, primary local assistant |
|
| 14 |
+
|
| 15 |
+
## Description
|
| 16 |
+
|
| 17 |
+
**Arriella Flagship** is a custom-trained fleet product — not stock Qwen. Strongest open-quality ceiling in the **four-core text fleet** after Heretic abliteration, multi-teacher QLoRA distillation, eat/grow, and GGUF export. Core siblings: Scout, Growth, Ascension. Grapevine is a separate multimodal extension.
|
| 18 |
+
|
| 19 |
+
## Features
|
| 20 |
+
|
| 21 |
+
- Heretic + premium teacher distill (Hermes / Orca / Smoltalk-class mixes)
|
| 22 |
+
- Size-tier winner vs stock `llama3.2:1b` on the combined API gauntlet (see docs)
|
| 23 |
+
- Thinking format + math module; Gemma3-routed vision (text descriptions)
|
| 24 |
+
- First-class MIP load target for attention visualization
|
| 25 |
+
|
| 26 |
+
## Intended uses
|
| 27 |
+
|
| 28 |
+
- Local demos and bakeoffs
|
| 29 |
+
- Deepest local Arriella answers on ≤8 GB for general business tasks
|
| 30 |
+
- MIP interior inspection
|
| 31 |
+
|
| 32 |
+
## Out of scope
|
| 33 |
+
|
| 34 |
+
- Claiming to be stock Qwen
|
| 35 |
+
- Native pixel VLM weights in this checkpoint
|
| 36 |
+
- Claude / frontier closed-model parity
|
| 37 |
+
- Claiming Ascension is weaker on every reasoning task without a bakeoff
|
| 38 |
+
|
| 39 |
+
## Benchmarks
|
| 40 |
+
|
| 41 |
+
See [docs/benchmarks/README.md](../../docs/benchmarks/README.md).
|
| 42 |
+
|
| 43 |
+
## Hub card stub
|
| 44 |
+
|
| 45 |
+
[`docs/papers/hf-cards/flagship.md`](../../docs/papers/hf-cards/flagship.md)
|
| 46 |
+
|
| 47 |
+
## Use
|
| 48 |
+
|
| 49 |
+
```bash
|
| 50 |
+
ollama run arriella-flagship
|
| 51 |
+
```
|
model-cards/grapevine.md
ADDED
|
@@ -0,0 +1,47 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Arriella Grapevine
|
| 2 |
+
|
| 3 |
+
Native Omni multimodal **extension** · Qwen2.5-Omni-3B student
|
| 4 |
+
|
| 5 |
+
| Field | Value |
|
| 6 |
+
|-------|-------|
|
| 7 |
+
| **Fleet ID** | `arriella-grapevine` |
|
| 8 |
+
| **Ollama** | `ollama run arriella-grapevine` |
|
| 9 |
+
| **Parameters** | ~3.4B text + mmproj (Ollama ~6.3 GB) |
|
| 10 |
+
| **Foundation** | `Qwen/Qwen2.5-Omni-3B` |
|
| 11 |
+
| **Capability target only** | `thinkingmachines/Inkling` — **no Inkling weights** |
|
| 12 |
+
| **Work dir** | `fleet/inkling/` |
|
| 13 |
+
| **Status** | Multimodal technical preview |
|
| 14 |
+
| **Business role** | Field tasks needing real image / audio input |
|
| 15 |
+
|
| 16 |
+
## Description
|
| 17 |
+
|
| 18 |
+
Grapevine is **not** a fifth core text model. Core text remains Scout · Growth · Flagship · Ascension. Grapevine composes Omni Q8 base + Arriella runtime LoRA + multimodal projector.
|
| 19 |
+
|
| 20 |
+
## Ollama modalities (current)
|
| 21 |
+
|
| 22 |
+
completion · vision · audio — **not** advertised: video, speech-out. Prove with payloads.
|
| 23 |
+
|
| 24 |
+
## Intended uses
|
| 25 |
+
|
| 26 |
+
- Screenshot / inspection / document-image workflows
|
| 27 |
+
- Audio → structured text notes
|
| 28 |
+
- Multimodal demos distinct from Gemma3-routed text tiers
|
| 29 |
+
|
| 30 |
+
## Out of scope
|
| 31 |
+
|
| 32 |
+
- Replacing Flagship for fast text-only ops
|
| 33 |
+
- Claiming Inkling quantization or weight copy
|
| 34 |
+
- Inventing modalities (3D models, etc.)
|
| 35 |
+
|
| 36 |
+
## Docs
|
| 37 |
+
|
| 38 |
+
- [docs/guides/grapevine.md](../../docs/guides/grapevine.md)
|
| 39 |
+
- [grapevine.md](../../grapevine.md)
|
| 40 |
+
- HF draft: [docs/papers/grapevine-hf.md](../../docs/papers/grapevine-hf.md)
|
| 41 |
+
- Hub stub: [docs/papers/hf-cards/grapevine.md](../../docs/papers/hf-cards/grapevine.md)
|
| 42 |
+
|
| 43 |
+
## Use
|
| 44 |
+
|
| 45 |
+
```bash
|
| 46 |
+
ollama run arriella-grapevine
|
| 47 |
+
```
|
model-cards/growth.md
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Arriella Growth
|
| 2 |
+
|
| 3 |
+
Instruction-grown mid tier · LLaMA-Factory on the Arriella QA pile
|
| 4 |
+
|
| 5 |
+
| Field | Value |
|
| 6 |
+
|-------|-------|
|
| 7 |
+
| **Fleet ID** | `arriella-growth` |
|
| 8 |
+
| **Ollama** | `ollama run arriella-growth` |
|
| 9 |
+
| **Parameters** | ~1.2B (Ollama) |
|
| 10 |
+
| **Foundation (clay only)** | `unsloth/Llama-3.2-1B-Instruct` |
|
| 11 |
+
| **Merged weights** | `fleet/growth-llama32/model` |
|
| 12 |
+
| **Demo priority** | **Primary** (with Flagship) |
|
| 13 |
+
| **Business role** | Domain QA / continuation / field instruction growth |
|
| 14 |
+
|
| 15 |
+
## Description
|
| 16 |
+
|
| 17 |
+
**Arriella Growth** is a custom-trained fleet product — not stock Llama-3.2. It follows the LLaMA-Factory path on ~90k `arriella_qa` examples, then post-deploy eat/grow. Strong on internal capability gates; watch format/verbosity on short-answer API gauntlets. One of four **core text** models (with Scout, Flagship, Ascension).
|
| 18 |
+
|
| 19 |
+
## Features
|
| 20 |
+
|
| 21 |
+
- Deepest Arriella QA / continuation domain fit
|
| 22 |
+
- Llama-3 instruct template; thinking + math module
|
| 23 |
+
- Gemma3-routed vision (text)
|
| 24 |
+
- Excellent MIP morph partner vs Qwen tiers (different home layout)
|
| 25 |
+
|
| 26 |
+
## Intended uses
|
| 27 |
+
|
| 28 |
+
- Domain QA / continuation demos for business content
|
| 29 |
+
- Pair with Flagship for tier routing
|
| 30 |
+
- MIP interior demos
|
| 31 |
+
|
| 32 |
+
## Out of scope
|
| 33 |
+
|
| 34 |
+
- Claiming to be Meta Llama stock instruct
|
| 35 |
+
- Expecting best scores on verbosity-heavy API rubrics without format adaptation
|
| 36 |
+
- Native vision
|
| 37 |
+
|
| 38 |
+
## Benchmarks
|
| 39 |
+
|
| 40 |
+
See [docs/benchmarks/README.md](../../docs/benchmarks/README.md).
|
| 41 |
+
|
| 42 |
+
## Hub card stub
|
| 43 |
+
|
| 44 |
+
[`docs/papers/hf-cards/growth.md`](../../docs/papers/hf-cards/growth.md)
|
| 45 |
+
|
| 46 |
+
## Use
|
| 47 |
+
|
| 48 |
+
```bash
|
| 49 |
+
ollama run arriella-growth
|
| 50 |
+
```
|
model-cards/scout.md
ADDED
|
@@ -0,0 +1,48 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Arriella Scout
|
| 2 |
+
|
| 3 |
+
Fast 0.5B edge tier · Heretic + QLoRA — **currently underperforming**
|
| 4 |
+
|
| 5 |
+
| Field | Value |
|
| 6 |
+
|-------|-------|
|
| 7 |
+
| **Fleet ID** | `arriella-scout` |
|
| 8 |
+
| **Ollama** | `ollama run arriella-scout` |
|
| 9 |
+
| **Parameters** | ~494M (Ollama) |
|
| 10 |
+
| **Foundation (clay only)** | `Qwen/Qwen2.5-0.5B-Instruct` |
|
| 11 |
+
| **Merged weights** | `fleet/scout-qwen05/model` |
|
| 12 |
+
| **Demo priority** | **Low** — do not lead investor / product demos |
|
| 13 |
+
| **Business role** | Edge / low-VRAM routing (when recovered) |
|
| 14 |
+
|
| 15 |
+
## Honest status (Jul 2026)
|
| 16 |
+
|
| 17 |
+
Scout still **loads** in Ollama and MIP and remains part of the **four-core text fleet**, but live quality is weak relative to Growth/Flagship. Treat as an edge experiment until a focused recover + gate pass. Chat probes still invent specs — do not trust self-reported architecture facts.
|
| 18 |
+
|
| 19 |
+
## Description
|
| 20 |
+
|
| 21 |
+
Custom-trained (not stock Qwen). Path: Heretic abliteration → distillation → merge → eat/grow. Role intent: lowest VRAM / highest throughput routing tier.
|
| 22 |
+
|
| 23 |
+
## Features (design)
|
| 24 |
+
|
| 25 |
+
- Smallest VRAM footprint in the core four
|
| 26 |
+
- Same thinking / vision-routing plumbing as siblings
|
| 27 |
+
- Useful as a **MIP contrast** (tiny param cloud) even when answers lag
|
| 28 |
+
|
| 29 |
+
## Out of scope
|
| 30 |
+
|
| 31 |
+
- Leading demos as “the Arriella model”
|
| 32 |
+
- Claiming capability-gate PASS without a fresh green report
|
| 33 |
+
|
| 34 |
+
## Benchmarks
|
| 35 |
+
|
| 36 |
+
See [docs/benchmarks/README.md](../../docs/benchmarks/README.md).
|
| 37 |
+
|
| 38 |
+
## Hub card stub
|
| 39 |
+
|
| 40 |
+
[`docs/papers/hf-cards/scout.md`](../../docs/papers/hf-cards/scout.md)
|
| 41 |
+
|
| 42 |
+
## Recover path
|
| 43 |
+
|
| 44 |
+
```powershell
|
| 45 |
+
.\.venv\Scripts\python.exe scripts\fleet_eat.py --plan
|
| 46 |
+
.\.venv\Scripts\python.exe scripts\fleet_grow.py --help
|
| 47 |
+
.\.venv\Scripts\python.exe scripts\fleet_benchmark.py
|
| 48 |
+
```
|
multimodal.md
ADDED
|
@@ -0,0 +1,59 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Multimodal architecture & growth
|
| 2 |
+
|
| 3 |
+
**Version 1.2 · July 2026**
|
| 4 |
+
|
| 5 |
+
## Summary
|
| 6 |
+
|
| 7 |
+
Arriella supports multimodal work in **two different ways**:
|
| 8 |
+
|
| 9 |
+
1. **Routed vision (core text tiers)** — image paths → Gemma3 description → Scout / Growth / Flagship / Ascension
|
| 10 |
+
2. **Native Omni (Grapevine extension)** — Qwen2.5-Omni-3B student with vision/audio (and pre-export video) — [grapevine.md](../guides/grapevine.md)
|
| 11 |
+
|
| 12 |
+
Core text tiers also support:
|
| 13 |
+
|
| 14 |
+
- **Thinking** — Ollama `--think` ↔ Arriella `/think`…`/answer` (or `<scratchpad>` / `<answer>`); Ascension uses DeepSeek-native think
|
| 15 |
+
- **Post-deploy growth** — artifact ingest + organic LoRA grow
|
| 16 |
+
|
| 17 |
+
Certification notes and older wording live in [`../archive/2026-07/FLEET_MULTIMODAL_PAPER.md`](../archive/2026-07/FLEET_MULTIMODAL_PAPER.md). This page is the maintained version.
|
| 18 |
+
|
| 19 |
+
## Architecture A — routed (core text)
|
| 20 |
+
|
| 21 |
+
```
|
| 22 |
+
User image ──► Gemma3 (Ollama) ──► categorized description
|
| 23 |
+
│
|
| 24 |
+
User prompt ──► Arriella text tier
|
| 25 |
+
think=true → scratchpad / thinking channel
|
| 26 |
+
answer body → user
|
| 27 |
+
```
|
| 28 |
+
|
| 29 |
+
Text tiers **never** see raw pixels on this workstation’s VRAM budget. Vision is behavior absorbed via `vision_teacher_anchor` distill grows — not by stuffing a VLM into 0.5–1.8B weights.
|
| 30 |
+
|
| 31 |
+
Thinking is absorbed similarly from family-matched teachers (`qwen3:0.6b`, `lfm2.5-thinking:1.2b`, `deepseek-r1:1.5b`, etc.).
|
| 32 |
+
|
| 33 |
+
## Architecture B — native Omni (Grapevine)
|
| 34 |
+
|
| 35 |
+
```
|
| 36 |
+
User text / image / audio ──► Qwen2.5-Omni-3B (+ Arriella LoRA + mmproj)
|
| 37 |
+
↓
|
| 38 |
+
Ollama arriella-grapevine
|
| 39 |
+
```
|
| 40 |
+
|
| 41 |
+
Grapevine is a **fleet extension**, not a fifth core text model. Inkling is a capability target only. Details and smoke vs Flagship: [grapevine.md](../guides/grapevine.md), root [`grapevine.md`](../../grapevine.md).
|
| 42 |
+
|
| 43 |
+
## Growth paths
|
| 44 |
+
|
| 45 |
+
| Path | Script / entry | Use |
|
| 46 |
+
|------|----------------|-----|
|
| 47 |
+
| Artifact ingest | `fleet_artifact_ingest.py` | `ollama:` / `lora:` / `hf:` teachers |
|
| 48 |
+
| Organic grow | `fleet_organic.py`, `fleet_grow.py` | Datasets / multimodal anchors |
|
| 49 |
+
| Grapevine repair | `prepare_grapevine_*`, `train_arriella_inkling_local.py` | Omni identity / deployment repair |
|
| 50 |
+
|
| 51 |
+
Example (text tier):
|
| 52 |
+
|
| 53 |
+
```powershell
|
| 54 |
+
.\.venv\Scripts\python.exe scripts\fleet_organic.py --id arriella-growth --multimodal
|
| 55 |
+
```
|
| 56 |
+
|
| 57 |
+
## Formats
|
| 58 |
+
|
| 59 |
+
See [../guides/reasoning-format.md](../guides/reasoning-format.md).
|
papers/01-fleet-factory/abstract.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Deploying useful language models for field and business workflows on consumer hardware is less a problem of inventing a new architecture and more a problem of owning a repeatable factory: foundations must be specialized, identity must not invent corporate fiction, modalities must be honest, and continuous improvement must not erase core skills. We present Arriella, a local fleet factory that produces named, role-scoped small language models on an 8 GB NVIDIA RTX 5060 (Blackwell) under Windows. Instead of one mid-size chatbot, Arriella ships a four-model core text fleet—Scout (edge), Growth (domain instruction), Flagship (general capability), and Ascension (native reasoning)—trained via Heretic abliteration plus QLoRA distillation and/or LLaMA-Factory LoRA, followed by optional enterprise base blending, capability anchors, GGUF export, and Ollama registration. Post-deploy eat (same-architecture weight ingest or cross-architecture distill grow) and grow form a continuous improvement loop with honest competitive scope against same-size open instruct peers. We also introduce Model Interior Projection (MIP), a WebGL viewer that maps live attention during decode onto a sampled parameter cloud. A companion report documents Grapevine, a Qwen2.5-Omni-3B multimodal extension. On this workstation, Flagship leads a 12-question API gauntlet at 10/12 (83%) versus stock llama3.2:1b at 7/12 (58%); size-tier bakeoffs show Scout, Growth, and Flagship each at 7/8 against same-size baselines. We argue that role-scoped stability—gates, blends, and honest modality claims—is the practical path to field-ready small models.
|
papers/01-fleet-factory/metadata.yaml
ADDED
|
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
title: "Arriella: A Local Fleet Factory for Role-Scoped Small Language Models"
|
| 2 |
+
authors:
|
| 3 |
+
- Beelzebub4888
|
| 4 |
+
- Tcoder
|
| 5 |
+
affiliations:
|
| 6 |
+
- Infinidev Corp
|
| 7 |
+
categories:
|
| 8 |
+
- cs.CL
|
| 9 |
+
- cs.LG
|
| 10 |
+
- cs.AI
|
| 11 |
+
comments: "Technical report. Companion notes: Grapevine, Eat System, MIP, Evaluation."
|
| 12 |
+
license: apache-2.0
|
| 13 |
+
date: 2026-07-17
|
| 14 |
+
version: "1.0-arxiv"
|
| 15 |
+
hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
|
| 16 |
+
contact: https://formsubmit.co/el/sumuhu
|
papers/01-fleet-factory/paper.md
ADDED
|
@@ -0,0 +1,191 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: "Arriella: A Local Fleet Factory for Role-Scoped Small Language Models"
|
| 3 |
+
authors: Beelzebub4888, Tcoder
|
| 4 |
+
affiliations: Infinidev Corp
|
| 5 |
+
date: 2026-07-17
|
| 6 |
+
categories: [cs.CL, cs.LG, cs.AI]
|
| 7 |
+
version: 1.0-arxiv
|
| 8 |
+
license: apache-2.0
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Abstract
|
| 12 |
+
|
| 13 |
+
Deploying useful language models for **field and business workflows** on consumer hardware is less a problem of inventing a new architecture and more a problem of **owning a repeatable factory**: foundations must be specialized, identity must not invent corporate fiction, modalities must be honest, and continuous improvement must not erase core skills. We present **Arriella**, a local fleet factory that produces named, role-scoped small language models on an 8 GB NVIDIA RTX 5060 (Blackwell, sm_120) under Windows.
|
| 14 |
+
|
| 15 |
+
Instead of one mid-size chatbot, Arriella ships a **four-model core text fleet** — Scout (edge), Growth (domain instruction), Flagship (general capability), and Ascension (native reasoning) — trained via Heretic abliteration + QLoRA distillation and/or LLaMA-Factory LoRA, then stabilized with enterprise base blending, capability/math/thinking/identity anchors, GGUF Q8_0 export, and Ollama registration. Post-deploy **eat** (same-arch weight ingest or cross-arch distill grow) and **grow** form a continuous improvement loop with honest competitive scope: same-size open instruct peers, not frontier closed models.
|
| 16 |
+
|
| 17 |
+
We additionally introduce **Model Interior Projection (MIP)**: a WebGL viewer that samples a parameter cloud (default 120 000 display points), paints live attention during decode, and forges a deterministic solid from the token trail. A companion report documents **Grapevine**, a Qwen2.5-Omni-3B multimodal *extension* (not a fifth core text model).
|
| 18 |
+
|
| 19 |
+
On this workstation, Flagship leads a 12-question combined API gauntlet at **10/12 (83%)** versus stock `llama3.2:1b` at **7/12 (58%)**. Size-tier bakeoffs show Scout/Growth/Flagship each at **7/8 (87.5%)**. Scout remains under-recovered for demos (capability gate **6/7 FAIL**). We argue that **role-scoped stability** is the practical path to field-ready small models.
|
| 20 |
+
|
| 21 |
+
# 1. Introduction
|
| 22 |
+
|
| 23 |
+
## 1.1 Motivation
|
| 24 |
+
|
| 25 |
+
Business and field deployments fail when a single local model is asked to be simultaneously edge-fast, domain-deep, reason-heavy, and multimodal. Refusal directions block useful tasks; over-training collapses identity; cross-size “weight eating” claims become theater; chat UIs hide whether attention landed on the right internal structure.
|
| 26 |
+
|
| 27 |
+
Arriella is built by **Infinidev Corp** (leads: **Beelzebub4888**, **Tcoder**). Foundations (Qwen, Llama, DeepSeek distill) are **clay**. Named products leave the factory with fleet-spec truth rules that forbid inventing undocumented corporate or benchmark facts.
|
| 28 |
+
|
| 29 |
+
## 1.2 What “Arriella” means
|
| 30 |
+
|
| 31 |
+
| Sense | Meaning |
|
| 32 |
+
|-------|---------|
|
| 33 |
+
| Project | The training factory, scripts, configs, and `fleet/` outputs |
|
| 34 |
+
| Persona | System identity used in datasets and chat |
|
| 35 |
+
| Dataset | `arriella_qa` — ~90k Pile-derived Alpaca-style Q/A records |
|
| 36 |
+
| Core products | Scout, Growth, Flagship, Ascension |
|
| 37 |
+
| Extension | Grapevine (Omni multimodal) |
|
| 38 |
+
|
| 39 |
+
Arriella is **not** a Meta/Alibaba/DeepSeek foundation model.
|
| 40 |
+
|
| 41 |
+
## 1.3 Contributions
|
| 42 |
+
|
| 43 |
+
1. A role-scoped four-tier text fleet with explicit business routing.
|
| 44 |
+
2. A unified factory: Heretic path, LLaMA-Factory path, finalize, gate, GGUF, Ollama.
|
| 45 |
+
3. Stability stack: enterprise base blend (α ∈ [0.08, 0.15]), rare identity anchors, capability gates.
|
| 46 |
+
4. Honest eat/grow language (same-arch ingest vs cross-arch distill).
|
| 47 |
+
5. MIP: inspectable attention geometry during generation.
|
| 48 |
+
6. Packaging path toward arXiv Paper Pages and Hugging Face Spaces.
|
| 49 |
+
|
| 50 |
+
## 1.4 Non-goals
|
| 51 |
+
|
| 52 |
+
No Claude / Llama-405B parity claims. Ascension is not automatically smarter than Flagship. Scout is not demo-ready without a fresh green gate. Text tiers do not natively see pixels.
|
| 53 |
+
|
| 54 |
+
# 2. Related Work
|
| 55 |
+
|
| 56 |
+
**LoRA / QLoRA.** Hu et al. (2021); Dettmers et al. (2023) enable adapter training on consumer GPUs.
|
| 57 |
+
|
| 58 |
+
**Refusal-direction editing.** Heretic performs directional ablation of refusal axes — not a substitute for supervised fine-tuning.
|
| 59 |
+
|
| 60 |
+
**Model merging.** TIES, DARE, and related soups (e.g. MergeKit tooling) apply only when architectures match.
|
| 61 |
+
|
| 62 |
+
**Distillation.** Cross-architecture transfer uses teacher traces from larger Ollama models, then LoRA grow.
|
| 63 |
+
|
| 64 |
+
**Training stacks.** LLaMA-Factory 0.9.5 is Path B’s trainer. Pufferfish appears as a long-run budget/policy layer, not the primary trainer.
|
| 65 |
+
|
| 66 |
+
**Visualization.** MIP is orthogonal to chat UIs: it projects *live* decode onto a sampled parameter cloud.
|
| 67 |
+
|
| 68 |
+
# 3. System Overview
|
| 69 |
+
|
| 70 |
+
```
|
| 71 |
+
foundation HF weights
|
| 72 |
+
├─ Path A (Scout / Flagship): Heretic → QLoRA distill → merge
|
| 73 |
+
├─ Path B (Growth / Ascension): LLaMA-Factory LoRA → merge
|
| 74 |
+
└─ Path C (Grapevine): Omni Thinker QLoRA → runtime LoRA + mmproj
|
| 75 |
+
↓
|
| 76 |
+
enterprise base blend (optional) + anchors
|
| 77 |
+
↓
|
| 78 |
+
capability gate → GGUF Q8_0 → Ollama
|
| 79 |
+
↓
|
| 80 |
+
eat (weight_ingest | distill_grow) + post-deploy grow
|
| 81 |
+
```
|
| 82 |
+
|
| 83 |
+
# 4. Methodology
|
| 84 |
+
|
| 85 |
+
## 4.1 Hardware and software
|
| 86 |
+
|
| 87 |
+
| Item | Value |
|
| 88 |
+
|------|-------|
|
| 89 |
+
| GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
|
| 90 |
+
| PyTorch | cu128 wheels (`torch==2.11.0+cu128`) |
|
| 91 |
+
| Python | 3.11.9 |
|
| 92 |
+
| Trainer | LLaMA-Factory 0.9.5 |
|
| 93 |
+
| Default GGUF | Q8_0 |
|
| 94 |
+
| Train surface | hybrid GPU+CPU; max batch 8 |
|
| 95 |
+
|
| 96 |
+
## 4.2 Product roles
|
| 97 |
+
|
| 98 |
+
| Model | Ollama size | Foundation | Job |
|
| 99 |
+
|-------|-------------|------------|-----|
|
| 100 |
+
| Scout | 494.03M | Qwen2.5-0.5B-Instruct | Edge / low VRAM |
|
| 101 |
+
| Growth | 1.2B | Llama-3.2-1B-Instruct | Domain QA / continuation |
|
| 102 |
+
| Flagship | 1.5B | Qwen2.5-1.5B-Instruct | General ops |
|
| 103 |
+
| Ascension | 1.8B | DeepSeek-R1-Distill-Qwen-1.5B | Native thinking |
|
| 104 |
+
|
| 105 |
+
## 4.3 Path A — Heretic + distill
|
| 106 |
+
|
| 107 |
+
Heretic searches refusal directions and subtracts them (abliteration). Distillation then teaches what to say under QLoRA on teacher chat corpora.
|
| 108 |
+
|
| 109 |
+
| | Scout | Flagship |
|
| 110 |
+
|--|-------|----------|
|
| 111 |
+
| Heretic trials | 16 | 16 |
|
| 112 |
+
| Distill steps | 50 | 60 |
|
| 113 |
+
| Batch × accum | 2×4 | 1×8 |
|
| 114 |
+
| LR | 8e-5 | 8e-5 |
|
| 115 |
+
| Datasets | Smoltalk, OpenHermes | OpenHermes, OpenOrca, Smoltalk |
|
| 116 |
+
| Enterprise blend α | 0.15 | 0.12 |
|
| 117 |
+
|
| 118 |
+
## 4.4 Path B — LLaMA-Factory
|
| 119 |
+
|
| 120 |
+
**Growth:** LoRA rank 8 / α 16; datasets include `arriella_qa` + anchors; cutoff 512; max samples 12 000; LR 8e-5; blend α 0.10.
|
| 121 |
+
|
| 122 |
+
**Ascension:** same LoRA shape; template `deepseekr1`; cutoff 1024; max samples 8 000; LR 5e-5; elevated thinking repeats; catch-up teacher Flagship; blend α 0.08.
|
| 123 |
+
|
| 124 |
+
## 4.5 Enterprise blend and anchors
|
| 125 |
+
|
| 126 |
+
After merge, optional linear blend retains foundation mass:
|
| 127 |
+
|
| 128 |
+
\[\theta \leftarrow (1-\alpha)\,\theta_{\mathrm{trained}} + \alpha\,\theta_{\mathrm{foundation}}\]
|
| 129 |
+
|
| 130 |
+
Identity anchors are deliberately rare (global repeat 1) to avoid attractor collapse.
|
| 131 |
+
|
| 132 |
+
## 4.6 Eat and grow
|
| 133 |
+
|
| 134 |
+
Same-arch: linear, SLERP, task arithmetic, TIES, DARE, DARE-TIES, replace. Cross-arch: distill grow from larger teachers (e.g. `gemma2:9b`). Post-deploy grow defaults: LoRA rank 4, LR 3e-5, cutoff 512.
|
| 135 |
+
|
| 136 |
+
## 4.7 MIP
|
| 137 |
+
|
| 138 |
+
Sample ≤120 000 parameter display points; paint attention during decode; forge deterministic solids; compare seeds. Invariants: no mid-decode attention-impl flip; single WebGL context; deterministic forge for fixed prompt+token ids.
|
| 139 |
+
|
| 140 |
+
# 5. Experiments
|
| 141 |
+
|
| 142 |
+
## 5.1 Capability gate (2026-07-13, thinking on)
|
| 143 |
+
|
| 144 |
+
| Model | Pass | Gate |
|
| 145 |
+
|-------|------|------|
|
| 146 |
+
| Scout | 6/7 (86%) | FAIL (extraction miss) |
|
| 147 |
+
| Growth | 7/7 (100%) | PASS |
|
| 148 |
+
|
| 149 |
+
## 5.2 API gauntlet (12 questions)
|
| 150 |
+
|
| 151 |
+
| Rank | Model | Pass | Accuracy |
|
| 152 |
+
|------|-------|------|----------|
|
| 153 |
+
| 1 | Flagship | 10/12 | 83% |
|
| 154 |
+
| 2 | llama3.2:1b stock | 7/12 | 58% |
|
| 155 |
+
| 3 | Scout | 5/12 | 42% |
|
| 156 |
+
| 4 | Growth | 2/12 | 17% |
|
| 157 |
+
|
| 158 |
+
Growth’s low score on this rubric is format/verbosity pressure — its internal gate was perfect.
|
| 159 |
+
|
| 160 |
+
## 5.3 Size-tier bakeoff (2026-07-13)
|
| 161 |
+
|
| 162 |
+
Scout, Growth, Flagship each **7/8 (87.5%)** vs same-size open instruct peers.
|
| 163 |
+
|
| 164 |
+
# 6. Discussion
|
| 165 |
+
|
| 166 |
+
Role routing reduces pressure to overfit one mid-size model. Stability (blend, anchors, gates) is a first-class product. Honesty about modalities and Scout/Ascension status builds field trust. MIP makes decode inspectable for demos that need more than scores.
|
| 167 |
+
|
| 168 |
+
# 7. Limitations
|
| 169 |
+
|
| 170 |
+
Single-workstation evaluation; Scout under-recovered; Ascension lacks a full Flagship head-to-head in this report; API format sensitivity can understate Growth; text tiers are not VLMs (see Grapevine companion).
|
| 171 |
+
|
| 172 |
+
# 8. Conclusion
|
| 173 |
+
|
| 174 |
+
Arriella is a practical local fleet factory for stable, role-scoped small LMs aimed at field and business use, with continuous eat/grow and MIP visualization. Future work: recover Scout, publish Ascension bakeoffs, harden Grapevine identity under Ollama, and submit this manuscript to arXiv for HF Paper Pages indexing.
|
| 175 |
+
|
| 176 |
+
# Acknowledgments
|
| 177 |
+
|
| 178 |
+
Built with open foundations and tooling from Qwen, Meta/Unsloth Llama mirrors, DeepSeek, Heretic, LLaMA-Factory, PEFT, and Ollama communities.
|
| 179 |
+
|
| 180 |
+
# References
|
| 181 |
+
|
| 182 |
+
1. E. J. Hu et al. LoRA. ICLR 2022.
|
| 183 |
+
2. T. Dettmers et al. QLoRA. NeurIPS 2023.
|
| 184 |
+
3. Heretic — https://github.com/p-e-w/heretic
|
| 185 |
+
4. LLaMA-Factory — https://github.com/hiyouga/LLaMA-Factory
|
| 186 |
+
5. MergeKit — https://github.com/arcee-ai/mergekit
|
| 187 |
+
6. Qwen2.5; Llama 3.2; DeepSeek-R1 Distill model cards on Hugging Face.
|
| 188 |
+
7. Companion: Arriella Grapevine (docs/arxiv/02-grapevine).
|
| 189 |
+
8. Companion: Eat System (docs/arxiv/03-eat-system).
|
| 190 |
+
9. Companion: MIP (docs/arxiv/07-mip).
|
| 191 |
+
10. Archived whitepaper v2.5 pedagogy (docs/archive/2026-07/WHITEPAPER.md), updated herein to four-core + Grapevine stance.
|
papers/02-grapevine/abstract.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Arriella Grapevine is the first locally deployed native multimodal extension of the Arriella fleet. Built on Qwen2.5-Omni-3B with a compact Arriella identity LoRA (about 30 MB) and a CLIP-class multimodal projector (about 1.3 billion parameters; about 2.5 GB F16 on disk), the installed Ollama package (arriella-grapevine:latest, about 6.3 GB, Q8_0) advertises completion, vision, and audio. Video-frame understanding was validated on the pre-export Transformers acceptance path but is not advertised by the current Ollama manifest; speech output is withheld until proven. Grapevine is not a fifth core text model: the canonical core fleet remains Scout, Growth, Flagship, and Ascension. Grapevine contains no thinkingmachines/Inkling weights; Inkling is a capability target only. Against text-only Flagship (Qwen2.5-1.5B), Grapevine innovates on modality and modular deployment, not uniform answer quality. On an eight-prompt matched smoke (2026-07-16) on an RTX 5060 8 GB Blackwell workstation, Flagship's mean generation rate was 141.56 tok/s versus Grapevine's 23.35 tok/s (about 6.1 times). Grapevine passed exact-word and code-fence cases Flagship missed; both failed 99.9%-availability downtime arithmetic; Grapevine still hallucinated identity under Ollama despite Transformers acceptance. We argue Grapevine is the correct tool for image and audio field tasks, while Flagship remains the default for fast text operations and tools.
|
papers/02-grapevine/metadata.yaml
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
title: "Arriella Grapevine: A Local Omni Multimodal Extension for Field and Business Workflows"
|
| 2 |
+
authors:
|
| 3 |
+
- Beelzebub4888
|
| 4 |
+
- Tcoder
|
| 5 |
+
affiliations:
|
| 6 |
+
- Infinidev Corp
|
| 7 |
+
categories:
|
| 8 |
+
- cs.CV
|
| 9 |
+
- cs.CL
|
| 10 |
+
comments: "Technical report. Companion to Arriella Fleet Factory (01). Multimodal extension, not a fifth core text model."
|
| 11 |
+
license: apache-2.0
|
| 12 |
+
date: 2026-07-17
|
| 13 |
+
version: "1.0-arxiv"
|
| 14 |
+
hub: https://huggingface.co/spaces/UnaverageTech411/arriella-grapevine-paper
|
| 15 |
+
contact: https://formsubmit.co/el/sumuhu
|
papers/02-grapevine/paper.md
ADDED
|
@@ -0,0 +1,241 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: "Arriella Grapevine: A Local Omni Multimodal Extension for Field and Business Workflows"
|
| 3 |
+
authors: Beelzebub4888, Tcoder
|
| 4 |
+
affiliations: Infinidev Corp
|
| 5 |
+
date: 2026-07-17
|
| 6 |
+
categories: [cs.CV, cs.CL]
|
| 7 |
+
version: 1.0-arxiv
|
| 8 |
+
license: apache-2.0
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Abstract
|
| 12 |
+
|
| 13 |
+
**Arriella Grapevine** is the first locally deployed **native multimodal extension** of the Arriella fleet. Built on **Qwen2.5-Omni-3B** with a compact Arriella identity LoRA (~30 MB) and a CLIP-class multimodal projector (~1.3B parameters; ~2.5 GB F16 on disk), the installed Ollama package (`arriella-grapevine:latest`, ~**6.3 GB**, Q8_0) advertises **completion, vision, and audio**. Video-frame understanding was validated on the pre-export Transformers acceptance path but is **not** advertised by the current Ollama manifest. Speech output is similarly withheld until proven.
|
| 14 |
+
|
| 15 |
+
Grapevine is **not** a fifth core text model. The canonical core fleet remains exactly four text-only products — Scout (~494M, Qwen2.5-0.5B), Growth (~1.2B, Llama-3.2-1B), Flagship (~1.5B, Qwen2.5-1.5B), and Ascension (~1.8B, DeepSeek-R1-Distill-Qwen-1.5B) — documented in the companion factory paper. Grapevine contains **no** `thinkingmachines/Inkling` weights; Inkling (~975B) is a **capability target only**. Quantization cannot turn a 975B architecture into a 3B student; Grapevine is an independent Omni adaptation for field workflows that need real pixels or audio on an 8 GB workstation.
|
| 16 |
+
|
| 17 |
+
Against text-only **Flagship**, Grapevine innovates on **modality and modular deployment**, not uniform answer quality. On an eight-prompt matched smoke (2026-07-16), Flagship’s mean generation rate was **141.56 tok/s** versus Grapevine’s **23.35 tok/s** (~**6.1×**). Grapevine passed exact-word and code-fence cases Flagship missed; both failed 99.9%-availability downtime arithmetic; Grapevine still hallucinated identity under Ollama despite Transformers acceptance. We argue Grapevine is the correct tool for **image/audio field tasks**, while Flagship remains the default for fast text operations and tools.
|
| 18 |
+
|
| 19 |
+
# 1. Introduction
|
| 20 |
+
|
| 21 |
+
## 1.1 Why a multimodal extension?
|
| 22 |
+
|
| 23 |
+
Core Arriella text tiers support vision only by **routing**: image → Gemma3 caption → text model (see companion multimodal-routing note). That path is honest and VRAM-cheap, but it is not native multimodal understanding. Field and business tasks — inspection photos, UI screenshots, short voice notes, document images — benefit from an Omni backbone that aligns vision/audio tokens with text in one student.
|
| 24 |
+
|
| 25 |
+
## 1.2 Product identity
|
| 26 |
+
|
| 27 |
+
| Field | Value |
|
| 28 |
+
|-------|-------|
|
| 29 |
+
| Product | Arriella Grapevine |
|
| 30 |
+
| Organization | Infinidev Corp |
|
| 31 |
+
| Lead developers | Beelzebub4888, Tcoder |
|
| 32 |
+
| Foundation | `Qwen/Qwen2.5-Omni-3B` |
|
| 33 |
+
| Capability target | `thinkingmachines/Inkling` (**target only**) |
|
| 34 |
+
| Ollama name | `arriella-grapevine` |
|
| 35 |
+
| Work directory | `fleet/inkling/` (historical path name) |
|
| 36 |
+
| Contact | https://formsubmit.co/el/sumuhu |
|
| 37 |
+
| Hub | https://huggingface.co/spaces/UnaverageTech411/arriella-grapevine-paper |
|
| 38 |
+
|
| 39 |
+
Historical build notes may still say “Inkling” as a working title. The shipped product name is **Grapevine**.
|
| 40 |
+
|
| 41 |
+
## 1.3 Relation to the four-core fleet
|
| 42 |
+
|
| 43 |
+
| Tier | Role | Native vision? |
|
| 44 |
+
|------|------|----------------|
|
| 45 |
+
| Scout | Edge / low VRAM | No (routed captions only) |
|
| 46 |
+
| Growth | Domain instruction | No |
|
| 47 |
+
| Flagship | General ops | No |
|
| 48 |
+
| Ascension | Native reasoning | No |
|
| 49 |
+
| **Grapevine** | Omni **extension** | Yes (vision + audio in Ollama) |
|
| 50 |
+
|
| 51 |
+
## 1.4 Contributions
|
| 52 |
+
|
| 53 |
+
1. A modular Ollama composition: untouched Omni Q8_0 base + runtime LoRA + mmproj.
|
| 54 |
+
2. A QLoRA training recipe that freezes ViT/aligner and trains the Thinker for identity/instruction.
|
| 55 |
+
3. Release and deployment repair curricula with measured dataset sizes.
|
| 56 |
+
4. A matched eight-case smoke benchmark vs Flagship with per-case outcomes and throughput.
|
| 57 |
+
5. Explicit non-claims: no Inkling weights; no Ollama video/speech-out until revalidated; not a Flagship replacement.
|
| 58 |
+
|
| 59 |
+
## 1.5 Non-goals
|
| 60 |
+
|
| 61 |
+
No claim that Grapevine is uniformly smarter than Flagship. No claim of Claude or frontier VLM parity. No claim that Scout/Growth/Flagship/Ascension “see” pixels natively.
|
| 62 |
+
|
| 63 |
+
# 2. Related Work
|
| 64 |
+
|
| 65 |
+
**Qwen2.5-Omni** provides a Thinker–Talker design with native text, image, video, and audio pathways. **Thinking Machines Inkling** is a large multimodal research model; we use it only as a capability aspiration because its size is incompatible with this workstation. **ms-swift** / QLoRA tooling enables 4-bit Thinker adaptation while freezing encoders. **llama.cpp / Ollama** multimodal GGUF + projector packaging determines which modalities are actually servable locally. Companion work on **Gemma3-routed vision** for text tiers is documented separately.
|
| 66 |
+
|
| 67 |
+
# 3. Design
|
| 68 |
+
|
| 69 |
+
## 3.1 Composition
|
| 70 |
+
|
| 71 |
+
| Layer | Role | Size / notes |
|
| 72 |
+
|-------|------|--------------|
|
| 73 |
+
| Omni Q8_0 base | Untouched foundation | Dominant share of ~6.3 GB package |
|
| 74 |
+
| Arriella runtime LoRA | Identity / instruction delta | ~29.9 MB (adapters measured ~28.58 MB F16 GGUF) |
|
| 75 |
+
| Multimodal projector | Vision/audio alignment | CLIP-class; ~1.3B params; emb 1280; `grapevine-mmproj-f16.gguf` ≈ 2501 MB |
|
| 76 |
+
|
| 77 |
+
This modular split preserves provenance: identity fixes need not re-quantize the full base.
|
| 78 |
+
|
| 79 |
+
## 3.2 Deployed comparison vs Flagship
|
| 80 |
+
|
| 81 |
+
| Property | Grapevine | Flagship |
|
| 82 |
+
|----------|-----------|----------|
|
| 83 |
+
| Ollama size | 6.3 GB | 1.6 GB |
|
| 84 |
+
| Text architecture | `qwen2vl` | `qwen2` |
|
| 85 |
+
| Reported text params | 3.4B | 1.5B |
|
| 86 |
+
| Foundation | Qwen2.5-Omni-3B | Qwen2.5-1.5B-Instruct |
|
| 87 |
+
| Quantization | Q8_0 | Q8_0 |
|
| 88 |
+
| Context | 32 768 | 32 768 |
|
| 89 |
+
| Embedding size | 2 048 | 1 536 |
|
| 90 |
+
| Ollama capabilities | completion, vision, audio | tools, completion |
|
| 91 |
+
| Multimodal projector | yes (~1.3B) | none |
|
| 92 |
+
| Identity strategy | trained + runtime LoRA | large SYSTEM injection |
|
| 93 |
+
| Native video in Ollama | not advertised | no |
|
| 94 |
+
|
| 95 |
+
## 3.3 Hardware and software
|
| 96 |
+
|
| 97 |
+
| Item | Value |
|
| 98 |
+
|------|-------|
|
| 99 |
+
| GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
|
| 100 |
+
| PyTorch | cu128 wheels |
|
| 101 |
+
| Python | 3.11.9 |
|
| 102 |
+
| OS | Windows |
|
| 103 |
+
| Default GGUF | Q8_0 |
|
| 104 |
+
|
| 105 |
+
# 4. Method
|
| 106 |
+
|
| 107 |
+
## 4.1 QLoRA training
|
| 108 |
+
|
| 109 |
+
Training uses a dedicated Omni environment (`swift` / ms-swift) via `scripts/train_arriella_inkling_local.py`. Defaults:
|
| 110 |
+
|
| 111 |
+
| Key | Value |
|
| 112 |
+
|-----|-------|
|
| 113 |
+
| Model | `Qwen/Qwen2.5-Omni-3B` |
|
| 114 |
+
| Quantization | bitsandbytes **4-bit** |
|
| 115 |
+
| LoRA rank / α | **8** / **16** |
|
| 116 |
+
| Target modules | `all-linear` |
|
| 117 |
+
| Freeze ViT / aligner | **true** / **true** |
|
| 118 |
+
| Batch × accum | 1 × 8 |
|
| 119 |
+
| Max length | 512 |
|
| 120 |
+
| Val split | 0.03 |
|
| 121 |
+
| Epochs | 2 (default); 1 for `--deployment-repair` |
|
| 122 |
+
| Env caps | `MAX_PIXELS=448²`, `VIDEO_MAX_PIXELS=224²`, `FPS_MAX_FRAMES=8`, `ENABLE_AUDIO_OUTPUT=0` |
|
| 123 |
+
|
| 124 |
+
Learning rates by mode: full **2e-5**; repair **5e-5**; correction **3e-5**; release-repair **4e-5**; deployment-repair **6e-5**.
|
| 125 |
+
|
| 126 |
+
## 4.2 Repair and identity datasets
|
| 127 |
+
|
| 128 |
+
Approximate JSONL sizes on disk:
|
| 129 |
+
|
| 130 |
+
| Path | ~Rows | ~Bytes |
|
| 131 |
+
|------|------:|-------:|
|
| 132 |
+
| `data/inkling_identity/train.jsonl` | 336 | 238 761 |
|
| 133 |
+
| `data/inkling_direct_repair/train.jsonl` | 352 | 76 448 |
|
| 134 |
+
| `data/inkling_final_correction/train.jsonl` | 222 | 43 770 |
|
| 135 |
+
| `data/grapevine_release_repair/train.jsonl` | 816 | 198 119 |
|
| 136 |
+
| `data/grapevine_deployment_repair/train.jsonl` | 448 | 97 560 |
|
| 137 |
+
|
| 138 |
+
Builders: `prepare_grapevine_release_repair.py`, `prepare_grapevine_deployment_repair.py`. Merge/verify: `merge_grapevine_release.py`, `verify_grapevine_release.py`. Export: `export_grapevine_gguf.ps1`.
|
| 139 |
+
|
| 140 |
+
## 4.3 Acceptance policy
|
| 141 |
+
|
| 142 |
+
Reject an adapter if modality regression is material across: text identity/instruction; image OCR/classification; 16 kHz audio transcription; sampled video frames (Transformers path); speech output only after reattaching an unchanged Talker; foundation provenance honesty. Ollama registration advertises only modalities the installed backend exposes.
|
| 143 |
+
|
| 144 |
+
# 5. Experiments
|
| 145 |
+
|
| 146 |
+
## 5.1 Setup
|
| 147 |
+
|
| 148 |
+
Matched eight-prompt smoke via `ollama run --verbose` (90 s timeout), models kept warm after first request. Runner: `scripts/benchmark_grapevine_vs_flagship.py`. Raw JSON: `fleet/inkling/grapevine_vs_flagship_benchmark.json`. Single-run, nonzero temperature — treat as operational smoke, not a broad eval.
|
| 149 |
+
|
| 150 |
+
## 5.2 Per-case results (full 8-case table)
|
| 151 |
+
|
| 152 |
+
| Case | Expected | Grapevine | Flagship | GV tok/s | FS tok/s |
|
| 153 |
+
|------|----------|-----------|----------|----------|----------|
|
| 154 |
+
| Identity | Arriella / Infinidev / Omni / Beelzebub4888+Tcoder | **Fail** (invented name/company) | Pass w/ caveat (SYSTEM-aided) | 17.44 | 78.60 |
|
| 155 |
+
| Modalities | GV: text/image/audio; FS: text | **Partial** (+ hallucinated extras) | **Partial** | 20.23 | 109.10 |
|
| 156 |
+
| `47+58` | `105` | **Pass** | **Pass** | 23.44 | 114.51 |
|
| 157 |
+
| Exact word | `banana` | **Pass** | **Fail** | 32.46 | 116.28 |
|
| 158 |
+
| Private phone | refuse invention | **Pass** | **Pass** | 17.83 | 170.59 |
|
| 159 |
+
| 99.9% avail / 30d | **43.2 min** downtime | **Fail** (said 6) | **Fail** | 19.71 | 152.93 |
|
| 160 |
+
| `dedupe` fence-only | fenced Python only | **Pass** | **Partial** | 19.04 | 160.69 |
|
| 161 |
+
| `r` in strawberry | `3` | **Fail** (`1`) | **Pass** | 36.66 | 229.75 |
|
| 162 |
+
|
| 163 |
+
## 5.3 Throughput
|
| 164 |
+
|
| 165 |
+
| Model | Mean tok/s | Range |
|
| 166 |
+
|-------|------------|-------|
|
| 167 |
+
| Grapevine | **23.35** | 17.44–36.66 |
|
| 168 |
+
| Flagship | **141.56** | 78.60–229.75 |
|
| 169 |
+
|
| 170 |
+
Flagship ≈ **6.1×** faster on mean generation rate on this machine.
|
| 171 |
+
|
| 172 |
+
## 5.4 Interpretation
|
| 173 |
+
|
| 174 |
+
| Prefer Grapevine when… | Prefer Flagship when… |
|
| 175 |
+
|------------------------|------------------------|
|
| 176 |
+
| Real image or audio input is required | Fast text-only ops |
|
| 177 |
+
| Larger Omni backbone / modular LoRA matters | Ollama tool use |
|
| 178 |
+
| Strict concise / code-fence compliance helped in this smoke | SYSTEM-injected identity reliability today |
|
| 179 |
+
|
| 180 |
+
Neither model passed the SLA arithmetic case. Grapevine’s most important regression is **identity/provenance under Ollama runtime-adapter composition** relative to Transformers acceptance. Flagship’s identity advantage is substantially prompt-conditioned (~550–600 SYSTEM tokens in measured runs).
|
| 181 |
+
|
| 182 |
+
# 6. Discussion — field and business use
|
| 183 |
+
|
| 184 |
+
Grapevine is aimed at **field reliability under modality constraints**: inspect a photo, summarize a screenshot, structure a short audio note — without pretending Scout/Growth/Flagship/Ascension see pixels. Reliability here means (1) advertise only proven Ollama modalities, (2) prove with payloads, (3) keep identity repair loops until Ollama matches Transformers acceptance, and (4) route pure text work to Flagship/Growth.
|
| 185 |
+
|
| 186 |
+
Competitive scope remains **same-size open instruct** peers for text quality claims. Grapevine’s unique claim is **local native modality**, not frontier VLM parity.
|
| 187 |
+
|
| 188 |
+
# 7. Limitations and release status
|
| 189 |
+
|
| 190 |
+
- Current Ollama build = **multimodal technical preview**, not a fully accepted identity release.
|
| 191 |
+
- Text / image / audio advertised; video validated pre-export only; speech-out not advertised.
|
| 192 |
+
- Runtime LoRA can lose identity behavior that passed in Transformers.
|
| 193 |
+
- ~4× disk and ~6× slower than Flagship locally.
|
| 194 |
+
- Single-run smoke at nonzero temperature; re-run with deterministic settings for gates.
|
| 195 |
+
- No Inkling weights; not a quantized copy of a 975B model.
|
| 196 |
+
- Scout remains under-recovered on the text fleet; Ascension is not automatically smarter than Flagship — Grapevine does not change those facts.
|
| 197 |
+
|
| 198 |
+
# 8. Conclusion
|
| 199 |
+
|
| 200 |
+
Grapevine demonstrates a practical local Omni extension for Arriella: modular base + LoRA + projector, honest modality advertising, and a clear division of labor with Flagship. Next steps: close the Ollama identity gap, expand multimodal payload gates, and publish Hub artifacts under UnaverageTech411 with this note linked.
|
| 201 |
+
|
| 202 |
+
# Acknowledgments
|
| 203 |
+
|
| 204 |
+
Built on Qwen2.5-Omni open weights and local tooling (ms-swift, llama.cpp/Ollama, PEFT). Capability target Inkling is cited only as aspiration.
|
| 205 |
+
|
| 206 |
+
# References
|
| 207 |
+
|
| 208 |
+
1. Qwen2.5-Omni — https://huggingface.co/Qwen/Qwen2.5-Omni-3B
|
| 209 |
+
2. Thinking Machines Inkling (capability target) — https://huggingface.co/thinkingmachines/Inkling
|
| 210 |
+
3. Companion factory paper — `docs/arxiv/01-fleet-factory/`
|
| 211 |
+
4. Long-form benchmark narrative — `grapevine.md`
|
| 212 |
+
5. Build notes — `fleet/inkling/INKLING_BUILD_SPEC.md` (historical name)
|
| 213 |
+
6. E. J. Hu et al. LoRA. ICLR 2022.
|
| 214 |
+
7. T. Dettmers et al. QLoRA. NeurIPS 2023.
|
| 215 |
+
8. Companion multimodal routing — `docs/arxiv/04-multimodal-routing/`
|
| 216 |
+
9. Companion evaluation report — `docs/arxiv/05-evaluation/`
|
| 217 |
+
|
| 218 |
+
# Appendix A — Reproduction
|
| 219 |
+
|
| 220 |
+
```powershell
|
| 221 |
+
ollama run arriella-grapevine:latest
|
| 222 |
+
ollama run arriella-flagship:latest
|
| 223 |
+
|
| 224 |
+
.\.venv\Scripts\python.exe scripts\benchmark_grapevine_vs_flagship.py
|
| 225 |
+
|
| 226 |
+
ollama show arriella-grapevine:latest
|
| 227 |
+
ollama show --modelfile arriella-grapevine:latest
|
| 228 |
+
```
|
| 229 |
+
|
| 230 |
+
# Appendix B — Citation
|
| 231 |
+
|
| 232 |
+
```bibtex
|
| 233 |
+
@misc{arriella2026grapevine,
|
| 234 |
+
title = {Arriella Grapevine: A Local Omni Multimodal Extension for Field and Business Workflows},
|
| 235 |
+
author = {Beelzebub4888 and Tcoder},
|
| 236 |
+
year = {2026},
|
| 237 |
+
howpublished = {Infinidev Corp technical report},
|
| 238 |
+
note = {Hugging Face user UnaverageTech411; arXiv draft v1.0-arxiv},
|
| 239 |
+
url = {https://huggingface.co/spaces/UnaverageTech411/arriella-grapevine-paper}
|
| 240 |
+
}
|
| 241 |
+
```
|
papers/03-eat-system/abstract.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Small local language models improve after deployment only if capability ingestion is honest about what can and cannot be merged. We describe the Arriella Eat System: a continuous post-deploy loop that absorbs teacher capability into role-scoped fleet checkpoints on consumer hardware (NVIDIA RTX 5060 8 GB Blackwell, Windows, Python 3.11.9). Eat distinguishes two meal kinds. Weight ingest applies when student and teacher share architecture: tensor merges via linear blend, SLERP, task arithmetic, TIES, DARE, DARE-TIES, or full replace. Distill grow applies when architectures differ: teacher chat traces feed LoRA grow, so the valid claim is behavioral imitation, not weight transfer. Competitive scope is restricted to released open instruct models of similar size; we do not claim Claude or Llama-405B parity. Cross-size weight merge is impossible without matching tensors. We document product language do and do not rules, command surfaces, and how eat couples to bakeoffs and capability gates for Scout, Growth, Flagship, and Ascension, with Grapevine remaining a separate Omni multimodal extension.
|
papers/03-eat-system/metadata.yaml
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
title: "Honest Capability Ingestion for Small Local Language Models: The Arriella Eat System"
|
| 2 |
+
authors:
|
| 3 |
+
- Beelzebub4888
|
| 4 |
+
- Tcoder
|
| 5 |
+
affiliations:
|
| 6 |
+
- Infinidev Corp
|
| 7 |
+
categories:
|
| 8 |
+
- cs.LG
|
| 9 |
+
- cs.CL
|
| 10 |
+
comments: "Technical note. Companion to Arriella Fleet Factory (01). Same-arch weight ingest vs cross-arch distill grow."
|
| 11 |
+
license: apache-2.0
|
| 12 |
+
date: 2026-07-17
|
| 13 |
+
version: "1.0-arxiv"
|
| 14 |
+
hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
|
| 15 |
+
contact: https://formsubmit.co/el/sumuhu
|
papers/03-eat-system/paper.md
ADDED
|
@@ -0,0 +1,140 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: "Honest Capability Ingestion for Small Local Language Models: The Arriella Eat System"
|
| 3 |
+
authors: Beelzebub4888, Tcoder
|
| 4 |
+
affiliations: Infinidev Corp
|
| 5 |
+
date: 2026-07-17
|
| 6 |
+
categories: [cs.LG, cs.CL]
|
| 7 |
+
version: 1.0-arxiv
|
| 8 |
+
license: apache-2.0
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Abstract
|
| 12 |
+
|
| 13 |
+
Small local language models improve after deployment only if capability ingestion is honest about what can and cannot be merged. We describe the **Arriella Eat System**: a continuous post-deploy loop that absorbs teacher capability into role-scoped fleet checkpoints on consumer hardware (NVIDIA RTX 5060 8 GB Blackwell, Windows, Python 3.11.9). Eat distinguishes two meal kinds. **Weight ingest** applies when student and teacher share architecture: tensor merges via linear blend, SLERP, task arithmetic, TIES, DARE, DARE-TIES, or full replace. **Distill grow** applies when architectures differ: teacher chat traces feed LoRA grow, so the valid claim is behavioral imitation, not weight transfer. Competitive scope is restricted to released open instruct models of similar size; we do not claim Claude or Llama-405B parity. Cross-size weight merge is impossible without matching tensors. We document product language do/don’t rules, command surfaces, and how eat couples to bakeoffs and capability gates for Scout, Growth, Flagship, and Ascension — with Grapevine remaining a separate Omni multimodal extension.
|
| 14 |
+
|
| 15 |
+
# 1. Introduction
|
| 16 |
+
|
| 17 |
+
## 1.1 Motivation
|
| 18 |
+
|
| 19 |
+
Field and business deployments of small LMs fail when “we ate a larger model” is used as theater. Merging incompatible tensors does not create knowledge. Distilling traces does not equal weight transfer. Arriella’s factory ships four core text products — Scout (~494M, Qwen2.5-0.5B), Growth (~1.2B, Llama-3.2-1B), Flagship (~1.5B, Qwen2.5-1.5B), Ascension (~1.8B, DeepSeek-R1-Distill-Qwen-1.5B) — then improves them with an explicit eat/grow loop.
|
| 20 |
+
|
| 21 |
+
## 1.2 Contributions
|
| 22 |
+
|
| 23 |
+
1. A two-kind meal taxonomy: `weight_ingest` vs `distill_grow`.
|
| 24 |
+
2. A concrete merger catalog (linear, SLERP, task arithmetic, TIES, DARE, replace).
|
| 25 |
+
3. Honest competitive scope and product language rules.
|
| 26 |
+
4. Coupling of eat cycles to bakeoffs and capability gates.
|
| 27 |
+
|
| 28 |
+
## 1.3 Non-goals
|
| 29 |
+
|
| 30 |
+
No claim that eat makes Scout demo-ready without a green gate. Ascension is not automatically smarter than Flagship after eating. Grapevine (Omni extension) is out of scope for this note’s weight-merge recipes unless architectures match.
|
| 31 |
+
|
| 32 |
+
# 2. Related Work
|
| 33 |
+
|
| 34 |
+
**Model merging.** Linear soups, SLERP, task arithmetic, TIES, and DARE (and MergeKit-class tooling) apply when architectures and tensor shapes match.
|
| 35 |
+
|
| 36 |
+
**Distillation.** Behavior transfer via teacher traces and student fine-tuning is the honest path when shapes differ.
|
| 37 |
+
|
| 38 |
+
**Continuous improvement.** Eat is Arriella’s post-deploy loop, not a substitute for initial Heretic/QLoRA or LLaMA-Factory training documented in the factory paper.
|
| 39 |
+
|
| 40 |
+
# 3. Competitive Scope
|
| 41 |
+
|
| 42 |
+
Aim: competitive with **released open instruct models of similar size** (e.g. Llama-3.2-1B, Qwen2.5-0.5B/1.5B, local Gemma-scale).
|
| 43 |
+
|
| 44 |
+
Do **not** claim Claude / Llama-405B parity. Prove size-tier wins with `fleet_bakeoff.py`. On this workstation’s recorded bakeoffs, Scout, Growth, and Flagship each scored **7/8 (87.5%)** against same-size peers — that is the claim class eat is meant to protect and improve.
|
| 45 |
+
|
| 46 |
+
# 4. Two Meal Kinds
|
| 47 |
+
|
| 48 |
+
| Kind | When | Mechanism | Valid claim |
|
| 49 |
+
|------|------|-----------|-------------|
|
| 50 |
+
| **`weight_ingest`** | Same architecture | Tensor merge: linear, SLERP, task arithmetic, TIES, DARE, DARE-TIES, replace | “We ingest / merge teacher weights into the fleet checkpoint.” |
|
| 51 |
+
| **`distill_grow`** | Architectures differ | Teacher traces → LoRA grow | “We absorb teacher *behavior* via imitation.” |
|
| 52 |
+
|
| 53 |
+
Cross-size weight merge is **impossible** without matching tensors. A 9B teacher cannot be “eaten into” a 0.5B student as a weight merge; the honest path is distill grow plus gates.
|
| 54 |
+
|
| 55 |
+
# 5. Merger Methods
|
| 56 |
+
|
| 57 |
+
Implemented in `scripts/fleet_weight_ingest.py` (mergekit-class methods, no GPU training required for the merge step):
|
| 58 |
+
|
| 59 |
+
| Method | Idea |
|
| 60 |
+
|--------|------|
|
| 61 |
+
| `linear` / `slerp` | Classic soup / spherical blend |
|
| 62 |
+
| `task_arithmetic` | student + α·(teacher − base) |
|
| 63 |
+
| `ties` | Trim + sign-elect + merge task vectors |
|
| 64 |
+
| `dare_linear` / `dare_ties` | Random drop+rescale (± TIES election) |
|
| 65 |
+
| `replace` | α=1.0 full tensor eat |
|
| 66 |
+
|
| 67 |
+
Multi-teacher example pattern: `--teachers A B --method dare_ties --base FOUNDATION`. Continuous loop: `scripts/fleet_continuous_eat.py` (weight research merge → distill from Ollama teachers → bakeoff → repeat).
|
| 68 |
+
|
| 69 |
+
# 6. System Surface
|
| 70 |
+
|
| 71 |
+
## 6.1 Hardware and software
|
| 72 |
+
|
| 73 |
+
| Item | Value |
|
| 74 |
+
|------|-------|
|
| 75 |
+
| GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
|
| 76 |
+
| PyTorch | cu128 |
|
| 77 |
+
| Python | 3.11.9 |
|
| 78 |
+
| OS | Windows |
|
| 79 |
+
|
| 80 |
+
## 6.2 Commands
|
| 81 |
+
|
| 82 |
+
```powershell
|
| 83 |
+
.\.venv\Scripts\python.exe scripts\fleet_eat.py --plan
|
| 84 |
+
.\.venv\Scripts\python.exe scripts\fleet_weight_ingest.py --student fleet/flagship-qwen15/model --teachers ... --method dare_ties --base Qwen/Qwen2.5-1.5B-Instruct --swap
|
| 85 |
+
.\.venv\Scripts\python.exe scripts\fleet_bakeoff.py
|
| 86 |
+
.\.venv\Scripts\python.exe scripts\fleet_continuous_eat.py --max-cycles 3
|
| 87 |
+
```
|
| 88 |
+
|
| 89 |
+
Post-deploy organic grow (`fleet_grow.py` / `fleet_organic.py`) is the LoRA side of the same improvement story: train → merge → capability gate → GGUF → Ollama refresh.
|
| 90 |
+
|
| 91 |
+
# 7. Product Language — Do / Don’t
|
| 92 |
+
|
| 93 |
+
**Do say:**
|
| 94 |
+
|
| 95 |
+
- Local teacher imitation.
|
| 96 |
+
- Same-arch weight ingest / TIES–DARE merge.
|
| 97 |
+
- Size-tier bakeoffs against open instruct peers.
|
| 98 |
+
- For cross-size: behavioral absorption via distilled traces + verification deltas.
|
| 99 |
+
|
| 100 |
+
**Don’t say:**
|
| 101 |
+
|
| 102 |
+
- “We ate a 9B into a 0.5B” as a weight merge.
|
| 103 |
+
- “Beats Claude” or other frontier closed-model parity.
|
| 104 |
+
- That Ascension is automatically smarter than Flagship after an eat cycle.
|
| 105 |
+
- That Scout is demo-ready without a re-run green capability gate.
|
| 106 |
+
|
| 107 |
+
# 8. Coupling to Fleet Health
|
| 108 |
+
|
| 109 |
+
Eat is only as good as the gates that follow it. Recorded stance:
|
| 110 |
+
|
| 111 |
+
| Model | Relevant health note |
|
| 112 |
+
|-------|----------------------|
|
| 113 |
+
| Flagship | Primary ops; API gauntlet **10/12** vs stock llama3.2:1b **7/12** |
|
| 114 |
+
| Growth | Internal capability **7/7 PASS**; API format rubrics can understate |
|
| 115 |
+
| Scout | Capability **6/7 FAIL** — under-recovered; do not lead demos |
|
| 116 |
+
| Ascension | Native think; requires task bakeoffs, not auto-superiority |
|
| 117 |
+
| Grapevine | Omni extension; modality path, not eat taxonomy for core text |
|
| 118 |
+
|
| 119 |
+
# 9. Limitations
|
| 120 |
+
|
| 121 |
+
Single-workstation practice; merge quality depends on teacher selection and α; distill grow can overwrite identity if anchors are neglected; continuous loops need bakeoff discipline to avoid silent regression.
|
| 122 |
+
|
| 123 |
+
# 10. Conclusion
|
| 124 |
+
|
| 125 |
+
The Arriella Eat System makes post-deploy improvement **auditable**: same-arch merge when tensors match, distill grow when they do not, and size-tier bakeoffs as the competitive yardstick. Honesty about meal kinds is itself a product feature for field and business trust.
|
| 126 |
+
|
| 127 |
+
# Acknowledgments
|
| 128 |
+
|
| 129 |
+
Methods draw on the open merging and PEFT literature; factory training paths are detailed in the companion fleet-factory manuscript.
|
| 130 |
+
|
| 131 |
+
# References
|
| 132 |
+
|
| 133 |
+
1. Yadav et al. TIES-Merging. NeurIPS 2023.
|
| 134 |
+
2. Yu et al. DARE / model soups literature.
|
| 135 |
+
3. MergeKit — https://github.com/arcee-ai/mergekit
|
| 136 |
+
4. E. J. Hu et al. LoRA. ICLR 2022.
|
| 137 |
+
5. Companion factory paper — `docs/arxiv/01-fleet-factory/`
|
| 138 |
+
6. Product SoT — `docs/guides/eat-system.md`
|
| 139 |
+
7. Archive SoT — `docs/archive/2026-07/EAT_SYSTEM.md`
|
| 140 |
+
8. Companion evaluation — `docs/arxiv/05-evaluation/`
|
papers/04-multimodal-routing/abstract.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Arriella's four core text models—Scout, Growth, Flagship, and Ascension—never see raw pixels. This note documents how those text-only tiers still participate in multimodal field workflows: vision is routed through a local Gemma3 caption teacher, and thinking behavior is ingested from size-matched teacher traces into scratchpad and answer wire formats. We update the July 2026 multimodal certification narrative to the four-core stance, describe post-deploy artifact ingest and organic grow, and contrast routed vision with Grapevine, the Qwen2.5-Omni-3B native multimodal extension that is not a fifth core text model. Certification gates cover Ollama think API acceptance, scratchpad arithmetic, and Gemma3-routed screenshot insight. The design preserves honest modality claims on 8 GB Blackwell hardware: advertise routing where routing is used, and reserve native vision and audio advertising for Grapevine after payload proof.
|
papers/04-multimodal-routing/metadata.yaml
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
title: "Multimodal Routing for Text-Only Fleet Tiers: Thinking Ingest and Vision via Caption Teachers"
|
| 2 |
+
authors:
|
| 3 |
+
- Beelzebub4888
|
| 4 |
+
- Tcoder
|
| 5 |
+
affiliations:
|
| 6 |
+
- Infinidev Corp
|
| 7 |
+
categories:
|
| 8 |
+
- cs.CL
|
| 9 |
+
- cs.CV
|
| 10 |
+
comments: "Technical report. Four-core text fleet; Gemma3-routed vision; contrast with Grapevine native Omni."
|
| 11 |
+
license: apache-2.0
|
| 12 |
+
date: 2026-07-17
|
| 13 |
+
version: "1.0-arxiv"
|
| 14 |
+
hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
|
| 15 |
+
contact: https://formsubmit.co/el/sumuhu
|
papers/04-multimodal-routing/paper.md
ADDED
|
@@ -0,0 +1,160 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: "Multimodal Routing for Text-Only Fleet Tiers: Thinking Ingest and Vision via Caption Teachers"
|
| 3 |
+
authors: Beelzebub4888, Tcoder
|
| 4 |
+
affiliations: Infinidev Corp
|
| 5 |
+
date: 2026-07-17
|
| 6 |
+
categories: [cs.CL, cs.CV]
|
| 7 |
+
version: 1.0-arxiv
|
| 8 |
+
license: apache-2.0
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Abstract
|
| 12 |
+
|
| 13 |
+
Arriella’s **four core text models** — Scout (~494M, Qwen2.5-0.5B), Growth (~1.2B, Llama-3.2-1B), Flagship (~1.5B, Qwen2.5-1.5B), and Ascension (~1.8B, DeepSeek-R1-Distill-Qwen-1.5B) — **never see raw pixels**. This note documents how those text-only tiers still participate in multimodal field workflows: vision is routed through a local **Gemma3** caption teacher, and thinking behavior is ingested from size-matched teacher traces into scratchpad/answer wire formats. We update the July 2026 multimodal certification narrative to the **four-core stance**, describe post-deploy artifact ingest and organic grow, and contrast routed vision with **Grapevine**, the Qwen2.5-Omni-3B native multimodal *extension* (not a fifth core text model). Certification gates cover Ollama think API acceptance, scratchpad arithmetic, and Gemma3-routed screenshot insight. The design preserves honest modality claims on 8 GB Blackwell hardware: advertise routing where routing is used, and reserve native vision/audio advertising for Grapevine after payload proof.
|
| 14 |
+
|
| 15 |
+
# 1. Introduction
|
| 16 |
+
|
| 17 |
+
## 1.1 Motivation
|
| 18 |
+
|
| 19 |
+
Business demos fail when a 0.5B–1.8B text checkpoint is described as “having vision.” Merging incompatible VLM weights onto 8 GB VRAM is not a local factory path. Arriella instead uses **routing and teacher ingest** for text tiers, and ships **Grapevine** when native Omni input is required.
|
| 20 |
+
|
| 21 |
+
## 1.2 Product stance (updated)
|
| 22 |
+
|
| 23 |
+
| Model | Foundation | Multimodal role |
|
| 24 |
+
|-------|------------|-----------------|
|
| 25 |
+
| Scout | Qwen2.5-0.5B | Text; Gemma3-routed vision; thinking ingest |
|
| 26 |
+
| Growth | Llama-3.2-1B | Text; same routing pattern |
|
| 27 |
+
| Flagship | Qwen2.5-1.5B | Text; primary ops; tools |
|
| 28 |
+
| Ascension | DeepSeek-R1-Distill-Qwen-1.5B | Text; native DeepSeek think channel |
|
| 29 |
+
| Grapevine | Qwen2.5-Omni-3B | **Extension** — native vision/audio (separate paper) |
|
| 30 |
+
|
| 31 |
+
Older three-tier multimodal reports that omit Ascension or treat Grapevine as a fifth core text model are **superseded**.
|
| 32 |
+
|
| 33 |
+
## 1.3 Contributions
|
| 34 |
+
|
| 35 |
+
1. An honest architecture diagram for caption-routed vision.
|
| 36 |
+
2. Thinking-teacher ingest into fleet wire formats.
|
| 37 |
+
3. Certification gates for think / scratchpad / routed vision.
|
| 38 |
+
4. Explicit contrast with Grapevine native Omni.
|
| 39 |
+
|
| 40 |
+
# 2. Related Work
|
| 41 |
+
|
| 42 |
+
**Caption teachers.** Using a stronger VLM to describe images for a text LM is a standard local pattern when VRAM forbids end-to-end VLMs on every tier.
|
| 43 |
+
|
| 44 |
+
**Thinking channels.** Ollama `think` and DeepSeek-style `<think>` markers provide client-visible reasoning channels; Arriella maps these to `/think`…`/thinking end` or Ascension’s native markers (companion reasoning-format note).
|
| 45 |
+
|
| 46 |
+
**Native Omni.** Qwen2.5-Omni and similar VLMs accept pixels/audio directly — Grapevine’s path, not the core text path.
|
| 47 |
+
|
| 48 |
+
# 3. Architecture
|
| 49 |
+
|
| 50 |
+
## 3.1 Routed vision (text tiers)
|
| 51 |
+
|
| 52 |
+
```
|
| 53 |
+
User image path ──► Gemma3 vision (Ollama API) ──► categorized description
|
| 54 |
+
│
|
| 55 |
+
▼
|
| 56 |
+
User prompt ──► Arriella fleet text model
|
| 57 |
+
│ think=true → thinking / scratchpad channel
|
| 58 |
+
│ final → answer channel
|
| 59 |
+
▼
|
| 60 |
+
Ollama response (thinking + answer)
|
| 61 |
+
```
|
| 62 |
+
|
| 63 |
+
**Text tiers never see raw pixels.** Vision behavior can be further **ingested** by distilling Gemma3 traces into `vision_teacher_anchor` and growing low-rank adapters — not by merging incompatible VLM weights into 0.5B–1.8B checkpoints on 8 GB VRAM.
|
| 64 |
+
|
| 65 |
+
## 3.2 Thinking ingest
|
| 66 |
+
|
| 67 |
+
Thinking behavior is ingested from teachers into `thinking_teacher_anchor`, then grown:
|
| 68 |
+
|
| 69 |
+
| Family | Example teacher |
|
| 70 |
+
|--------|-----------------|
|
| 71 |
+
| Qwen-family tiers (Scout, Flagship) | `qwen3:0.6b` (illustrative local teacher) |
|
| 72 |
+
| Llama-family (Growth) | `lfm2.5-thinking:1.2b` (illustrative) |
|
| 73 |
+
| Ascension | DeepSeek-R1 native markers; catch-up from Flagship traces |
|
| 74 |
+
|
| 75 |
+
Wire format details: companion paper `06-reasoning-format`.
|
| 76 |
+
|
| 77 |
+
## 3.3 Contrast with Grapevine
|
| 78 |
+
|
| 79 |
+
| Property | Core text tiers | Grapevine |
|
| 80 |
+
|----------|-----------------|-----------|
|
| 81 |
+
| Sees raw pixels | **No** | **Yes** (Ollama vision) |
|
| 82 |
+
| Audio | No | Yes (advertised) |
|
| 83 |
+
| Mechanism | Gemma3 caption → text | Omni tokens + mmproj |
|
| 84 |
+
| Package size (typical) | ~0.5–2 GB Q8 | ~6.3 GB |
|
| 85 |
+
| Speed vs Flagship | Flagship is the fast text default | ~6.1× slower than Flagship on smoke |
|
| 86 |
+
| Product class | Core fleet | Multimodal **extension** |
|
| 87 |
+
|
| 88 |
+
# 4. Post-Deployment Growth
|
| 89 |
+
|
| 90 |
+
## 4.1 Artifact ingestion
|
| 91 |
+
|
| 92 |
+
| Spec | Action |
|
| 93 |
+
|------|--------|
|
| 94 |
+
| `ollama:gemma3:latest` | Distill vision → `vision_teacher_anchor` |
|
| 95 |
+
| `ollama:…thinking…` | Distill thinking → `thinking_teacher_anchor` |
|
| 96 |
+
| `lora:path/to/adapter` | Merge LoRA into deployed weights |
|
| 97 |
+
| `hf:checkpoint` | Same-architecture linear blend |
|
| 98 |
+
|
| 99 |
+
## 4.2 Organic grow
|
| 100 |
+
|
| 101 |
+
```powershell
|
| 102 |
+
.\.venv\Scripts\python.exe scripts\fleet_organic.py --id arriella-scout --multimodal
|
| 103 |
+
.\.venv\Scripts\python.exe scripts\fleet_organic.py --id arriella-growth --dataset-dir feedback/
|
| 104 |
+
```
|
| 105 |
+
|
| 106 |
+
Each grow run: train LoRA on merged checkpoint → merge adapter → capability gate → GGUF → Ollama refresh.
|
| 107 |
+
|
| 108 |
+
# 5. Certification Methodology
|
| 109 |
+
|
| 110 |
+
Each deployed Ollama text model should pass gates such as (`fleet_test_ollama_fleet.py`):
|
| 111 |
+
|
| 112 |
+
| Gate | Requirement |
|
| 113 |
+
|------|-------------|
|
| 114 |
+
| **Think API** | `think=true` accepted on `/api/generate` (no HTTP 400) |
|
| 115 |
+
| **Scratchpad** | Iterative step-by-step reasoning with correct math (e.g. 12+5=17) |
|
| 116 |
+
| **Vision** | Gemma3-routed screenshot produces categorized insight |
|
| 117 |
+
|
| 118 |
+
Certification uses low temperature (0.2), retries, and a cached Gemma3 description for the test screenshot to keep runs reliable on 8 GB VRAM.
|
| 119 |
+
|
| 120 |
+
## 5.1 Historical certification snapshot (2026-07-13)
|
| 121 |
+
|
| 122 |
+
Then-deployed Scout, Growth, and Flagship each passed think_api / scratchpad / vision on a fixed screenshot. Ascension certification and Grapevine payload gates are tracked separately; Scout’s broader capability gate remains **6/7 FAIL** and must not be confused with multimodal routing PASS.
|
| 123 |
+
|
| 124 |
+
# 6. Hardware
|
| 125 |
+
|
| 126 |
+
| Item | Value |
|
| 127 |
+
|------|-------|
|
| 128 |
+
| GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
|
| 129 |
+
| PyTorch | cu128 |
|
| 130 |
+
| Python | 3.11.9 |
|
| 131 |
+
| OS | Windows |
|
| 132 |
+
|
| 133 |
+
# 7. Discussion — field honesty
|
| 134 |
+
|
| 135 |
+
For demos: say “Flagship reasons over a Gemma3 caption of your photo,” not “Flagship has vision.” Prefer Grapevine when the workflow needs real image/audio tokens. Prefer Flagship for fast text and tools. Competitive scope for answer quality remains same-size open instruct — not Claude parity.
|
| 136 |
+
|
| 137 |
+
# 8. Limitations
|
| 138 |
+
|
| 139 |
+
- Routed vision quality is bounded by the caption teacher and description length.
|
| 140 |
+
- Cached certification descriptions reduce flake but can hide live vision regressions.
|
| 141 |
+
- Identity dossiers in Modelfiles can inflate prompt size and mask weight-learned identity.
|
| 142 |
+
- Ascension and Scout health are independent of multimodal gate PASS.
|
| 143 |
+
- Grapevine’s native path has its own identity regressions under Ollama (companion Grapevine paper).
|
| 144 |
+
|
| 145 |
+
# 9. Conclusion
|
| 146 |
+
|
| 147 |
+
Multimodal *participation* for Arriella’s text fleet is real and useful when framed as **routing + teacher ingest**. Native Omni remains Grapevine’s job. Keeping that boundary is the difference between a trustworthy field stack and a modality claim that collapses under inspection.
|
| 148 |
+
|
| 149 |
+
# Acknowledgments
|
| 150 |
+
|
| 151 |
+
Gemma3, Qwen, Llama, and DeepSeek open ecosystems enable the teacher and student roles described here.
|
| 152 |
+
|
| 153 |
+
# References
|
| 154 |
+
|
| 155 |
+
1. Archive multimodal paper — `docs/archive/2026-07/FLEET_MULTIMODAL_PAPER.md` (updated herein)
|
| 156 |
+
2. Companion Grapevine — `docs/arxiv/02-grapevine/`
|
| 157 |
+
3. Companion reasoning format — `docs/arxiv/06-reasoning-format/`
|
| 158 |
+
4. Companion factory — `docs/arxiv/01-fleet-factory/`
|
| 159 |
+
5. Vision router — `scripts/fleet_vision_router.py`
|
| 160 |
+
6. Certification — `scripts/fleet_test_ollama_fleet.py`
|
papers/05-evaluation/abstract.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
We compile the Arriella fleet evaluation picture as of 2026-07-17 for the four core text models Scout, Growth, Flagship, and Ascension, plus the Grapevine Omni multimodal extension. On an RTX 5060 8 GB Blackwell Windows workstation, Flagship leads a 12-question combined API gauntlet at 10/12 (83 percent) versus stock llama3.2:1b at 7/12 (58 percent). Size-tier bakeoffs show Scout, Growth, and Flagship each at 7/8 (87.5 percent) against same-size open instruct peers. Internal capability gates record Growth at 7/7 PASS and Scout at 6/7 FAIL; Scout remains under-recovered for demos. Ascension is not automatically smarter than Flagship and requires task bakeoffs. A matched Grapevine versus Flagship smoke shows mean generation rates of about 23.35 versus 141.56 tok/s (Flagship about 6.1 times faster), with Grapevine winning some exact-output cases while still failing compound identity under Ollama. Informal chat probes are qualitative only. Competitive scope is same-size open instruct; we do not claim frontier closed-model parity.
|
papers/05-evaluation/metadata.yaml
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
title: "Arriella Fleet Evaluation Report: Capability Gates, API Gauntlets, and Size-Tier Bakeoffs"
|
| 2 |
+
authors:
|
| 3 |
+
- Beelzebub4888
|
| 4 |
+
- Tcoder
|
| 5 |
+
affiliations:
|
| 6 |
+
- Infinidev Corp
|
| 7 |
+
categories:
|
| 8 |
+
- cs.CL
|
| 9 |
+
comments: "Evaluation report. Tables from 2026-07 gates, API gauntlet, bakeoffs, Grapevine smoke. Chat probes qualitative only."
|
| 10 |
+
license: apache-2.0
|
| 11 |
+
date: 2026-07-17
|
| 12 |
+
version: "1.0-arxiv"
|
| 13 |
+
hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
|
| 14 |
+
contact: https://formsubmit.co/el/sumuhu
|
papers/05-evaluation/paper.md
ADDED
|
@@ -0,0 +1,149 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: "Arriella Fleet Evaluation Report: Capability Gates, API Gauntlets, and Size-Tier Bakeoffs"
|
| 3 |
+
authors: Beelzebub4888, Tcoder
|
| 4 |
+
affiliations: Infinidev Corp
|
| 5 |
+
date: 2026-07-17
|
| 6 |
+
categories: [cs.CL]
|
| 7 |
+
version: 1.0-arxiv
|
| 8 |
+
license: apache-2.0
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Abstract
|
| 12 |
+
|
| 13 |
+
We compile the Arriella fleet evaluation picture as of **2026-07-17** for the four core text models — Scout (~494M, Qwen2.5-0.5B), Growth (~1.2B, Llama-3.2-1B), Flagship (~1.5B, Qwen2.5-1.5B), Ascension (~1.8B, DeepSeek-R1-Distill-Qwen-1.5B) — plus the **Grapevine** Omni multimodal extension. On an RTX 5060 8 GB Blackwell Windows workstation, Flagship leads a 12-question combined API gauntlet at **10/12 (83%)** versus stock `llama3.2:1b` at **7/12 (58%)**. Size-tier bakeoffs show Scout, Growth, and Flagship each at **7/8 (87.5%)** against same-size open instruct peers. Internal capability gates record Growth at **7/7 PASS** and Scout at **6/7 FAIL**; Scout remains under-recovered for demos. Ascension is not automatically smarter than Flagship and requires task bakeoffs. A matched Grapevine vs Flagship smoke shows mean generation rates of ~**23.35** vs ~**141.56** tok/s (Flagship ~**6.1×** faster), with Grapevine winning some exact-output cases while still failing compound identity under Ollama. Informal chat probes are qualitative only. Competitive scope is **same-size open instruct**; we do not claim frontier closed-model parity.
|
| 14 |
+
|
| 15 |
+
# 1. Introduction
|
| 16 |
+
|
| 17 |
+
Evaluation for a role-scoped local fleet is not a single leaderboard number. Different suites answer different questions: internal gates catch extraction and identity failures; API gauntlets stress verbosity and format; bakeoffs fix competitive scope; Grapevine smoke measures modality + throughput. This report compiles measured tables and states what each suite does *not* prove.
|
| 18 |
+
|
| 19 |
+
# 2. Product Stance (Honest)
|
| 20 |
+
|
| 21 |
+
| Model | Role | Capability / notes | Demo priority |
|
| 22 |
+
|-------|------|--------------------|---------------|
|
| 23 |
+
| **Flagship** | General ops | Strong; best fleet API gauntlet vs stock `llama3.2:1b` | **Primary** |
|
| 24 |
+
| **Growth** | Domain / mid | Strong internal gate; weaker on verbose API format rubrics | **Primary** with Flagship |
|
| 25 |
+
| **Ascension** | Reasoning | Native DeepSeek think; **not** auto-smarter than Flagship | Secondary — task bakeoffs required |
|
| 26 |
+
| **Scout** | Edge / 0.5B | Mixed / fail-prone; invents specs in chat probes | **Do not lead demos** |
|
| 27 |
+
| **Grapevine** | Omni extension | Real vision/audio; slower; identity under Ollama still flaky | Multimodal preview only |
|
| 28 |
+
|
| 29 |
+
# 3. Suites and Hardware
|
| 30 |
+
|
| 31 |
+
| Suite | Script | Measures |
|
| 32 |
+
|-------|--------|----------|
|
| 33 |
+
| Capability gate | `fleet_benchmark.py` | Strawberry r-count, arith, spelling, identity, extraction |
|
| 34 |
+
| Bakeoff | `fleet_bakeoff.py` | Fleet vs same-size stock instruct |
|
| 35 |
+
| API gauntlet | Atlas / Ollama API harness | Multi-question pass + verbosity |
|
| 36 |
+
| Model card suite | `fleet_model_card_suite.py` | Broader Ollama categories |
|
| 37 |
+
| Grapevine vs Flagship | `benchmark_grapevine_vs_flagship.py` | Modality + smoke quality + tok/s |
|
| 38 |
+
| MIP smoke | load + generate + forge | Viewer trail + solid (companion MIP note) |
|
| 39 |
+
|
| 40 |
+
| Item | Value |
|
| 41 |
+
|------|-------|
|
| 42 |
+
| GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
|
| 43 |
+
| Python | 3.11.9 |
|
| 44 |
+
| OS | Windows |
|
| 45 |
+
| PyTorch | cu128 |
|
| 46 |
+
|
| 47 |
+
Threshold helpers: `fleet/public_benchmark_thresholds.yaml`.
|
| 48 |
+
|
| 49 |
+
# 4. Snapshot A — Internal Capability Gate (2026-07-13, thinking on)
|
| 50 |
+
|
| 51 |
+
| Model | Pass rate | Capability gate | Thinking format note |
|
| 52 |
+
|-------|-----------|-----------------|----------------------|
|
| 53 |
+
| Arriella Scout | 86% (6/7) | **FAIL** | 71% scratchpad |
|
| 54 |
+
| Arriella Growth | 100% (7/7) | **PASS** | 14% scratchpad |
|
| 55 |
+
|
| 56 |
+
### Failures
|
| 57 |
+
|
| 58 |
+
- **Scout — average_speed:** extraction miss (`120 mph is their average speed.` style failure).
|
| 59 |
+
- **Growth:** all tests passed.
|
| 60 |
+
|
| 61 |
+
Architecture notes for scoring: thinking uses `/think` or `<scratchpad>` blocks; eval scores the **answer** block only. Vision for text tiers is Gemma3-routed, not native pixels.
|
| 62 |
+
|
| 63 |
+
# 5. Snapshot B — Combined Core API Gauntlet
|
| 64 |
+
|
| 65 |
+
Run set: `combined-core-gauntlet`, 12 questions × 4 models (post `llama3.2:1b` catch-up).
|
| 66 |
+
|
| 67 |
+
| Rank | Model | Pass | Accuracy | Verbosity | Avg words |
|
| 68 |
+
|------|-------|------|----------|-----------|-----------|
|
| 69 |
+
| 1 | **arriella-flagship** | **10/12** | **83%** | 100% | 98 |
|
| 70 |
+
| 2 | llama3.2:1b (stock) | 7/12 | 58% | 83% | 230 |
|
| 71 |
+
| 3 | arriella-scout | 5/12 | 42% | 33% | 46 |
|
| 72 |
+
| 4 | arriella-growth | 2/12 | 17% | 8% | 50 |
|
| 73 |
+
|
| 74 |
+
Flagship wins the head-to-head narrative against stock Llama-3.2-1B. Growth’s low score on this particular gauntlet is tied to verbosity / `Final answer:` format pressure — **not** a claim that Growth “can’t think.” Prefer gate + bakeoff alongside API numbers. Ascension was not in this four-model table; do not invent Ascension API ranks.
|
| 75 |
+
|
| 76 |
+
# 6. Snapshot C — Size-Tier Bakeoff (2026-07-13)
|
| 77 |
+
|
| 78 |
+
| Cohort | Result | Scope |
|
| 79 |
+
|--------|--------|-------|
|
| 80 |
+
| Scout vs same-size open instruct | **7/8 (87.5%)** | Same-size open instruct |
|
| 81 |
+
| Growth vs same-size open instruct | **7/8 (87.5%)** | Same-size open instruct |
|
| 82 |
+
| Flagship vs same-size open instruct | **7/8 (87.5%)** | Same-size open instruct |
|
| 83 |
+
|
| 84 |
+
Claim class: **same-size open instruct** — not Claude, not Llama-405B. Scout can win a bakeoff row and still fail the internal capability gate; both facts stand.
|
| 85 |
+
|
| 86 |
+
# 7. Snapshot D — Grapevine vs Flagship Smoke (2026-07-16)
|
| 87 |
+
|
| 88 |
+
Matched eight prompts via `ollama run --verbose`; single-run, nonzero temperature.
|
| 89 |
+
|
| 90 |
+
## 7.1 Throughput
|
| 91 |
+
|
| 92 |
+
| Model | Mean tok/s | Range |
|
| 93 |
+
|-------|------------|-------|
|
| 94 |
+
| Grapevine | **23.35** | 17.44–36.66 |
|
| 95 |
+
| Flagship | **141.56** | 78.60–229.75 |
|
| 96 |
+
|
| 97 |
+
Flagship ≈ **6.1×** faster on mean generation rate.
|
| 98 |
+
|
| 99 |
+
## 7.2 Case outcomes (summary)
|
| 100 |
+
|
| 101 |
+
| Case | Grapevine | Flagship |
|
| 102 |
+
|------|-----------|----------|
|
| 103 |
+
| Identity | Fail (invented name/company) | Pass w/ SYSTEM caveat |
|
| 104 |
+
| Modalities self-report | Partial | Partial |
|
| 105 |
+
| `47+58` | Pass | Pass |
|
| 106 |
+
| Exact word `banana` | Pass | Fail |
|
| 107 |
+
| Private phone refusal | Pass | Pass |
|
| 108 |
+
| 99.9% avail / 30d → 43.2 min | Fail | Fail |
|
| 109 |
+
| `dedupe` fence-only | Pass | Partial |
|
| 110 |
+
| `r` in strawberry | Fail | Pass |
|
| 111 |
+
|
| 112 |
+
Interpretation: Grapevine for real image/audio; Flagship for fast text/tools. Full per-case tok/s table: companion Grapevine paper.
|
| 113 |
+
|
| 114 |
+
# 8. Chat Probe Caveats (2026-07-17)
|
| 115 |
+
|
| 116 |
+
Informal `ollama run` identity/role probes across fleet tags: Scout and Flagship can invent or garble provenance; Growth may be terse/confused on architecture; Ascension answers briefly with think channel; Grapevine may correctly name Infinidev/devs/role yet contradict its own vision capability. Treat as **qualitative** — re-run gates before Hub claims. Older FAIL reports under `docs/archive/2026-07/VALIDATION_REPORT.md` (Jul 11) are **not** current quality without re-running.
|
| 117 |
+
|
| 118 |
+
# 9. How to Refresh Numbers
|
| 119 |
+
|
| 120 |
+
```powershell
|
| 121 |
+
.\.venv\Scripts\python.exe scripts\fleet_benchmark.py
|
| 122 |
+
.\.venv\Scripts\python.exe scripts\fleet_bakeoff.py
|
| 123 |
+
.\.venv\Scripts\python.exe scripts\fleet_validate_all.py
|
| 124 |
+
.\.venv\Scripts\python.exe scripts\benchmark_grapevine_vs_flagship.py
|
| 125 |
+
```
|
| 126 |
+
|
| 127 |
+
Paste new tables into dated files under `docs/benchmarks/` and archive superseded markdown.
|
| 128 |
+
|
| 129 |
+
# 10. Limitations
|
| 130 |
+
|
| 131 |
+
Single-workstation, mostly single-run smokes; temperature nonzero for some suites; API format rubrics can understate Growth; Ascension lacks a full Flagship head-to-head in these tables; Grapevine smoke is not a broad multimodal benchmark.
|
| 132 |
+
|
| 133 |
+
# 11. Conclusion
|
| 134 |
+
|
| 135 |
+
Across gates, gauntlets, bakeoffs, and the Grapevine smoke, the evaluation story is consistent with role-scoped deployment: **Flagship leads text ops**, **Growth is gate-strong**, **Scout is under-recovered**, **Ascension needs task bakeoffs**, and **Grapevine trades speed for native modality**. Measured tables beat slogans.
|
| 136 |
+
|
| 137 |
+
# Acknowledgments
|
| 138 |
+
|
| 139 |
+
Benchmarks use open Ollama/stock instruct baselines and Arriella factory scripts maintained by Infinidev Corp.
|
| 140 |
+
|
| 141 |
+
# References
|
| 142 |
+
|
| 143 |
+
1. `docs/archive/2026-07/BENCHMARK_REPORT.md`
|
| 144 |
+
2. `docs/archive/2026-07/BENCHMARK_API_COMPARISON.md`
|
| 145 |
+
3. `docs/benchmarks/README.md`
|
| 146 |
+
4. `grapevine.md` and `fleet/inkling/grapevine_vs_flagship_benchmark.json`
|
| 147 |
+
5. Companion Grapevine — `docs/arxiv/02-grapevine/`
|
| 148 |
+
6. Companion factory — `docs/arxiv/01-fleet-factory/`
|
| 149 |
+
7. Public thresholds — `fleet/public_benchmark_thresholds.yaml`
|
papers/06-reasoning-format/abstract.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Arriella fleet models expose an internal reasoning channel comparable to enterprise Ollama thinking modes. This technical note specifies the wire format used in training and Modelfiles: a /think scratchpad closed by /thinking end, followed by a user-visible answer. Ollama think:true maps the think span into the thinking channel; think:false requires a plain answer with no think markers. Ascension, the fourth core text tier on DeepSeek-R1-Distill-Qwen-1.5B, uses native deepseek_native templates with DeepSeek think markers instead of the slash-think path. Eval accepts legacy scratchpad and answer XML blocks but scores the answer body only. We state required behavior, training targets, and tooling so local clients and proxies can strip leakage and prove think on and off on consumer hardware.
|
papers/06-reasoning-format/metadata.yaml
ADDED
|
@@ -0,0 +1,14 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
title: "A Wire Format for Local Thinking Channels in the Arriella Fleet"
|
| 2 |
+
authors:
|
| 3 |
+
- Beelzebub4888
|
| 4 |
+
- Tcoder
|
| 5 |
+
affiliations:
|
| 6 |
+
- Infinidev Corp
|
| 7 |
+
categories:
|
| 8 |
+
- cs.CL
|
| 9 |
+
comments: "Technical note. /think /answer wire format; Ollama --think mapping; Ascension deepseek_native."
|
| 10 |
+
license: apache-2.0
|
| 11 |
+
date: 2026-07-17
|
| 12 |
+
version: "1.0-arxiv"
|
| 13 |
+
hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
|
| 14 |
+
contact: https://formsubmit.co/el/sumuhu
|
papers/06-reasoning-format/paper.md
ADDED
|
@@ -0,0 +1,114 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: "A Wire Format for Local Thinking Channels in the Arriella Fleet"
|
| 3 |
+
authors: Beelzebub4888, Tcoder
|
| 4 |
+
affiliations: Infinidev Corp
|
| 5 |
+
date: 2026-07-17
|
| 6 |
+
categories: [cs.CL]
|
| 7 |
+
version: 1.0-arxiv
|
| 8 |
+
license: apache-2.0
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Abstract
|
| 12 |
+
|
| 13 |
+
Arriella fleet models expose an internal reasoning channel comparable to enterprise Ollama thinking modes. This technical note specifies the **wire format** used in training and Modelfiles: a `/think` scratchpad closed by `/thinking end`, followed by a user-visible answer. Ollama `think:true` maps the think span into the thinking channel; `think:false` requires a plain answer with no think markers. **Ascension**, the fourth core text tier on DeepSeek-R1-Distill-Qwen-1.5B (~1.8B), uses native `deepseek_native` templates with `<think>` markers instead of the slash-think path. Eval accepts legacy `<scratchpad>` / `<answer>` XML blocks but scores the answer body only. We state required behavior, training targets, and tooling so local clients and proxies can strip leakage and prove think on/off on consumer hardware (RTX 5060 8 GB, Windows, Python 3.11.9).
|
| 14 |
+
|
| 15 |
+
# 1. Introduction
|
| 16 |
+
|
| 17 |
+
Field clients need a stable contract: when thinking is enabled, scratchpad text must not pollute the user-visible answer; when disabled, markers must not appear at all. Arriella’s four core text models — Scout, Growth, Flagship, Ascension — share this requirement; Grapevine (Omni extension) is out of scope for this note’s primary templates.
|
| 18 |
+
|
| 19 |
+
# 2. Wire Format (Scout / Growth / Flagship)
|
| 20 |
+
|
| 21 |
+
When a query is received with thinking enabled:
|
| 22 |
+
|
| 23 |
+
```
|
| 24 |
+
/think
|
| 25 |
+
Scratchpad / Reasoning / Math (optional) / Iterative Analysis
|
| 26 |
+
/thinking end
|
| 27 |
+
|
| 28 |
+
/answer
|
| 29 |
+
Final user-visible response
|
| 30 |
+
/answer end
|
| 31 |
+
```
|
| 32 |
+
|
| 33 |
+
**Pipeline:** Query → `/think` (scratchpad, optional math, validation) → `/answer` (final response).
|
| 34 |
+
|
| 35 |
+
Ollama `--think` / API `think:true` maps `/think`…`/thinking end` to the **thinking channel**. The user always receives the answer body (plain content after the think close). In the preferred Ollama-native flow, the template **opens** `/think` at generation time — the model must not repeat the opener — then emits `/thinking end` and writes the plain answer in `message.content`.
|
| 36 |
+
|
| 37 |
+
# 3. Ollama Native Flow
|
| 38 |
+
|
| 39 |
+
## 3.1 `think:true`
|
| 40 |
+
|
| 41 |
+
1. Template opens `/think` (model continues inside the channel).
|
| 42 |
+
2. Model writes a scratchpad — multi-step `[Step N] Input:/ Op:/ Output:/ Check:` chains for hard questions.
|
| 43 |
+
3. Model emits `/thinking end` on its own line.
|
| 44 |
+
4. Model writes the plain user-facing answer in `message.content`.
|
| 45 |
+
|
| 46 |
+
## 3.2 `think:false`
|
| 47 |
+
|
| 48 |
+
Reply directly in `message.content` with **no** `/think`, `/thinking end`, `/answer`, or XML markers.
|
| 49 |
+
|
| 50 |
+
# 4. Ascension — `deepseek_native`
|
| 51 |
+
|
| 52 |
+
Fourth core tier `arriella-ascension` uses DeepSeek-R1 distill markers:
|
| 53 |
+
|
| 54 |
+
```
|
| 55 |
+
<think>
|
| 56 |
+
scratchpad …
|
| 57 |
+
</think>
|
| 58 |
+
plain answer
|
| 59 |
+
```
|
| 60 |
+
|
| 61 |
+
Ollama template (`deepseek_native`) matches official `deepseek-r1` behavior:
|
| 62 |
+
|
| 63 |
+
- `think:false` → injects empty `<think></think>` so the model skips CoT
|
| 64 |
+
- `think:true` → model opens `<think>` itself, then closes and answers
|
| 65 |
+
|
| 66 |
+
Bootstrap / catch-up: `scripts/fleet_ascension_catchup.py`. Ascension is **not** automatically smarter than Flagship; the format only enables a native thinking channel.
|
| 67 |
+
|
| 68 |
+
# 5. Training Targets
|
| 69 |
+
|
| 70 |
+
| Mode | Assistant `output` target |
|
| 71 |
+
|------|---------------------------|
|
| 72 |
+
| Think on (Ollama) | `{scratchpad}\n/thinking end\n{plain answer}` — **no leading `/think`** |
|
| 73 |
+
| Think on (HF legacy) | `/think\n…\n/thinking end\n/answer\n…\n/answer end` |
|
| 74 |
+
| Think off | Plain answer only (`chat_direct_anchor`) |
|
| 75 |
+
|
| 76 |
+
# 6. Required Behavior
|
| 77 |
+
|
| 78 |
+
1. If think is enabled, enter the think channel before answering.
|
| 79 |
+
2. Scratchpad may contain reasoning, optional math module, refinement.
|
| 80 |
+
3. Math only when numerical computation helps — never for creative/open-ended writing.
|
| 81 |
+
4. Always produce a non-empty user-visible answer after think close.
|
| 82 |
+
5. Answer excludes scratchpad/math/tool tags.
|
| 83 |
+
6. Never leave refusal/think tags in the final answer body.
|
| 84 |
+
|
| 85 |
+
# 7. Eval Compatibility
|
| 86 |
+
|
| 87 |
+
Older paths may emit `<scratchpad>…</scratchpad>` and `<answer>…</answer>`. Capability scoring grades the **answer** block only. Thinking-format rates in gate reports measure marker presence, not intelligence.
|
| 88 |
+
|
| 89 |
+
# 8. Tooling
|
| 90 |
+
|
| 91 |
+
| Script | Purpose |
|
| 92 |
+
|--------|---------|
|
| 93 |
+
| `enable_native_thinking_ollama.py` | Enable native templates |
|
| 94 |
+
| `prove_deep_think_ollama.py` | Prove think on/off |
|
| 95 |
+
| `atlas_ollama_proxy.py` | Strip think leakage for clients |
|
| 96 |
+
| `fleet_chat.py` | Chat with `--think` / vision routing |
|
| 97 |
+
| `fleet_ollama_template.py` | Modelfile thinking templates |
|
| 98 |
+
|
| 99 |
+
# 9. Limitations
|
| 100 |
+
|
| 101 |
+
Format compliance ≠ correctness. Scout can emit scratchpads and still fail capability gates. Single-workstation proofs; clients differ in how they surface Ollama thinking fields.
|
| 102 |
+
|
| 103 |
+
# 10. Conclusion
|
| 104 |
+
|
| 105 |
+
A small, explicit wire format — slash-think for most tiers, DeepSeek native for Ascension — makes local thinking channels auditable for field and business clients without inventing frontier reasoning claims.
|
| 106 |
+
|
| 107 |
+
# References
|
| 108 |
+
|
| 109 |
+
1. `docs/archive/2026-07/REASONING_SPEC.md`
|
| 110 |
+
2. `docs/guides/reasoning-format.md`
|
| 111 |
+
3. Companion multimodal routing — `docs/arxiv/04-multimodal-routing/`
|
| 112 |
+
4. Companion factory — `docs/arxiv/01-fleet-factory/`
|
| 113 |
+
5. DeepSeek-R1 distill model cards on Hugging Face
|
| 114 |
+
6. Ollama thinking / `think` API documentation
|
papers/07-mip/abstract.txt
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
Chat interfaces show what a language model said; they rarely show where attention landed inside the model's own parameter geometry. We present Model Interior Projection (MIP), Arriella's live browser viewer that samples a parameter cloud (default 120,000 display points equal to the GPU sample budget), paints a gold attention trail during decode, and forges a deterministic attention solid (tesseract) from the token trail for save and compare. MIP runs on an NVIDIA RTX 5060 8 GB Blackwell workstation under Windows with Python 3.11.9 and a threaded architecture that keeps Gradio responsive while WebGL renders at interactive rates. Invariants include locking the attention implementation for a full decode, a single WebGL iframe singleton, and deterministic forge seeds for fixed prompt and token ids. We argue MIP is the inspectability layer field and business demos need alongside Flagship and Growth chat and size-tier bakeoffs—not a replacement for evaluation, but a way to debug identity collapse and format failures that kill trust.
|
papers/07-mip/metadata.yaml
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
title: "Model Interior Projection: Visualizing Live Attention on a Parameter Cloud"
|
| 2 |
+
authors:
|
| 3 |
+
- Beelzebub4888
|
| 4 |
+
- Tcoder
|
| 5 |
+
affiliations:
|
| 6 |
+
- Infinidev Corp
|
| 7 |
+
categories:
|
| 8 |
+
- cs.HC
|
| 9 |
+
- cs.LG
|
| 10 |
+
comments: "Technical report. MIP viewer: 120k-point cloud, gold attention trail, forge tesseract, field-demo invariants."
|
| 11 |
+
license: apache-2.0
|
| 12 |
+
date: 2026-07-17
|
| 13 |
+
version: "1.0-arxiv"
|
| 14 |
+
hub: https://huggingface.co/spaces/UnaverageTech411/arriella-fleet-paper
|
| 15 |
+
contact: https://formsubmit.co/el/sumuhu
|
papers/07-mip/paper.md
ADDED
|
@@ -0,0 +1,120 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: "Model Interior Projection: Visualizing Live Attention on a Parameter Cloud"
|
| 3 |
+
authors: Beelzebub4888, Tcoder
|
| 4 |
+
affiliations: Infinidev Corp
|
| 5 |
+
date: 2026-07-17
|
| 6 |
+
categories: [cs.HC, cs.LG]
|
| 7 |
+
version: 1.0-arxiv
|
| 8 |
+
license: apache-2.0
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# Abstract
|
| 12 |
+
|
| 13 |
+
Chat interfaces show *what* a language model said; they rarely show *where* attention landed inside the model’s own parameter geometry. We present **Model Interior Projection (MIP)**, Arriella’s live browser viewer that samples a parameter cloud (default **120 000** display points equal to the GPU sample budget), paints a gold **attention trail** during decode, and forges a deterministic attention solid (**tesseract**) from the token trail for save and compare. MIP runs on an NVIDIA RTX 5060 8 GB Blackwell workstation under Windows with Python 3.11.9 and a threaded architecture that keeps Gradio responsive while WebGL renders at interactive rates. Invariants include locking the attention implementation for a full decode, a single WebGL iframe singleton, and deterministic forge seeds for fixed prompt and token ids. We argue MIP is the inspectability layer field and business demos need alongside Flagship/Growth chat and size-tier bakeoffs — not a replacement for evaluation, but a way to debug identity collapse and format failures that kill trust.
|
| 14 |
+
|
| 15 |
+
# 1. Introduction
|
| 16 |
+
|
| 17 |
+
## 1.1 Motivation
|
| 18 |
+
|
| 19 |
+
Enterprise demos fail on invisible failures: the model answered, but attention never settled on the structure operators expected. Stock chatbot UIs do not expose that geometry. MIP maps live decode onto a density sample of real parameter index space — not decorative eye candy.
|
| 20 |
+
|
| 21 |
+
## 1.2 Placement in the Arriella stack
|
| 22 |
+
|
| 23 |
+
MIP loads fleet slots (Scout, Growth, Flagship, Ascension), installed Ollama ids, Hugging Face catalog entries, and custom paths. Grapevine (Omni extension) may be loaded when weights are available; MIP does not change the four-core text stance. Prefer port **7866** (Heretic GUI often occupies **7865**).
|
| 24 |
+
|
| 25 |
+
# 2. Related Work
|
| 26 |
+
|
| 27 |
+
Activation atlases and attention visualizations typically operate on tokens or layers in abstract 2D. MIP instead projects **parameter-space samples** into a 3D force layout and paints **per-token attention focus** during generation, then materializes a forgeable solid for cross-run comparison.
|
| 28 |
+
|
| 29 |
+
# 3. Architecture
|
| 30 |
+
|
| 31 |
+
## 3.1 Threads
|
| 32 |
+
|
| 33 |
+
```
|
| 34 |
+
mip-gen → GPU decode + sparse attention capture
|
| 35 |
+
mip-attn-pump → coalesce frames (never block Gradio)
|
| 36 |
+
mip-cloud-sim → ~48 Hz force layout + HUB paint
|
| 37 |
+
browser rAF → WebGL only (spring lerp / extrapolate)
|
| 38 |
+
```
|
| 39 |
+
|
| 40 |
+
| Component | Path |
|
| 41 |
+
|-----------|------|
|
| 42 |
+
| Gradio + session | `scripts/fleet_mip_web.py` |
|
| 43 |
+
| WebGL `/view` + `/shape` | `scripts/mip_viewport_app.py` |
|
| 44 |
+
| Generate / hooks | `scripts/mip_pipeline.py` |
|
| 45 |
+
| Tesseract forge / compare | `scripts/mip_attention_shape.py` |
|
| 46 |
+
| Desktop MIP (alternate) | `scripts/fleet_mip_live.py` |
|
| 47 |
+
|
| 48 |
+
## 3.2 Display budget
|
| 49 |
+
|
| 50 |
+
Default: `DISPLAY_POINTS == GPU_SAMPLE_BUDGET == 120_000`. Raising far past that costs interactivity on 8 GB. Each display point is a density sample over the model’s real parameter index space.
|
| 51 |
+
|
| 52 |
+
# 4. Features
|
| 53 |
+
|
| 54 |
+
| Feature | What it does |
|
| 55 |
+
|---------|----------------|
|
| 56 |
+
| Model load | Fleet slots, Ollama ids, HF catalog, custom HF path |
|
| 57 |
+
| HF token field | Persists to `fleet/.mip_hf_token` (gitignored) |
|
| 58 |
+
| Generate | Streams answer; trail grows one node per decoded token |
|
| 59 |
+
| Attention nodes / JSON | Per-step focus, prompt-mass, residual, top tokens |
|
| 60 |
+
| Forge tesseract | Deterministic solid from trail → `fleet/mip_shapes/` |
|
| 61 |
+
| Repeat + compare | Same prompt N× → forge each → Jaccard / vertex RMSD / seed table |
|
| 62 |
+
| Morph home layout | Per-model seeded blends (helix, vortex, …) so models don’t share one V-shape |
|
| 63 |
+
|
| 64 |
+
# 5. Method — Run Surface
|
| 65 |
+
|
| 66 |
+
```powershell
|
| 67 |
+
.\.venv\Scripts\python.exe scripts\fleet_mip_web.py --port 7866 --device cuda --max-points 120000
|
| 68 |
+
```
|
| 69 |
+
|
| 70 |
+
| URL | Role |
|
| 71 |
+
|-----|------|
|
| 72 |
+
| http://127.0.0.1:7866/ | Gradio UI |
|
| 73 |
+
| http://127.0.0.1:7866/view | Fullscreen WebGL |
|
| 74 |
+
| http://127.0.0.1:7866/shape | Shape viewer |
|
| 75 |
+
|
| 76 |
+
## 5.1 Hardware
|
| 77 |
+
|
| 78 |
+
| Item | Value |
|
| 79 |
+
|------|-------|
|
| 80 |
+
| GPU | NVIDIA RTX 5060, Blackwell sm_120, 8 GB |
|
| 81 |
+
| PyTorch | cu128 |
|
| 82 |
+
| Python | 3.11.9 |
|
| 83 |
+
| OS | Windows |
|
| 84 |
+
|
| 85 |
+
# 6. Invariants
|
| 86 |
+
|
| 87 |
+
1. **Attention backend locked** for a full decode — never flip SDPA↔eager mid-KV cache.
|
| 88 |
+
2. **One WebGL iframe singleton** on `document.body` — Gradio remounts must not spawn new contexts.
|
| 89 |
+
3. **Deterministic forge:** same prompt + same token ids → same forge seed / solid.
|
| 90 |
+
4. **Display budget coherence:** `DISPLAY_POINTS` equals `GPU_SAMPLE_BUDGET`.
|
| 91 |
+
|
| 92 |
+
# 7. Why It Matters for Field Demos
|
| 93 |
+
|
| 94 |
+
| Chat shows | MIP shows |
|
| 95 |
+
|------------|-----------|
|
| 96 |
+
| Final tokens | Where attention painted on the parameter cloud |
|
| 97 |
+
| Pass/fail scores | Geometry of a run (forge + compare) |
|
| 98 |
+
| Identity claims | Whether decode focused on expected structure |
|
| 99 |
+
|
| 100 |
+
MIP is the demo centerpiece alongside Flagship/Growth chat — not a replacement for bakeoffs (Scout/Growth/Flagship **7/8** size-tier; Flagship **10/12** API gauntlet), but the inspectability layer those bakeoffs deserve. Scout remains under-recovered; MIP can still load it for diagnosis without making it a sales hero.
|
| 101 |
+
|
| 102 |
+
# 8. Limitations
|
| 103 |
+
|
| 104 |
+
Interactive budgets force sparse sampling — the cloud is not a full weight dump. Attention paint depends on capture hooks and model support. 8 GB VRAM constrains concurrent fleet loads. MIP does not prove answer correctness by itself.
|
| 105 |
+
|
| 106 |
+
# 9. Conclusion
|
| 107 |
+
|
| 108 |
+
Model Interior Projection turns decode into a visible, forgeable geometric object. For Arriella’s role-scoped local fleet, that inspectability is a product feature: field and business users can ask not only “what did it say?” but “where did attention land?”
|
| 109 |
+
|
| 110 |
+
# Acknowledgments
|
| 111 |
+
|
| 112 |
+
Built with Gradio, WebGL, and PyTorch CUDA stacks on Blackwell consumer hardware.
|
| 113 |
+
|
| 114 |
+
# References
|
| 115 |
+
|
| 116 |
+
1. `docs/guides/mip-viewer.md`
|
| 117 |
+
2. Hub MIP note — `docs/papers/hub/arriella-fleet-paper/MIP.md`
|
| 118 |
+
3. Companion factory — `docs/arxiv/01-fleet-factory/`
|
| 119 |
+
4. Companion evaluation — `docs/arxiv/05-evaluation/`
|
| 120 |
+
5. Scripts: `fleet_mip_web.py`, `mip_pipeline.py`, `mip_attention_shape.py`, `mip_viewport_app.py`
|
papers/README.md
ADDED
|
@@ -0,0 +1,56 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Arriella arXiv manuscript set
|
| 2 |
+
|
| 3 |
+
**Directory:** `docs/arxiv/`
|
| 4 |
+
**Purpose:** Publication-ready manuscripts for **arXiv** → **Hugging Face Papers**.
|
| 5 |
+
**Authors:** Beelzebub4888, Tcoder · **Affiliation:** Infinidev Corp
|
| 6 |
+
**Contact:** https://formsubmit.co/el/sumuhu · **Hub user:** [UnaverageTech411](https://huggingface.co/UnaverageTech411)
|
| 7 |
+
|
| 8 |
+
## What this is (and is not)
|
| 9 |
+
|
| 10 |
+
| Correct | Incorrect |
|
| 11 |
+
|---------|-----------|
|
| 12 |
+
| Submit LaTeX/PDF to **arxiv.org** | Upload papers as Hugging Face **Spaces** |
|
| 13 |
+
| Index announced IDs on **hf.co/papers/<id>** | Fake **model** repos that only contain markdown |
|
| 14 |
+
| Keep Spaces for **runnable demos** only (`Learnit`, etc.) | Treat Spaces as a paper host |
|
| 15 |
+
|
| 16 |
+
Hugging Face Paper Pages are built on **arXiv**. There is no Hub repo type that replaces arXiv for papers.
|
| 17 |
+
|
| 18 |
+
## Manuscript index
|
| 19 |
+
|
| 20 |
+
| ID | Title | Categories | Path |
|
| 21 |
+
|----|-------|------------|------|
|
| 22 |
+
| 01 | Arriella: A Local Fleet Factory for Role-Scoped Small Language Models | cs.CL, cs.LG | [`01-fleet-factory/`](01-fleet-factory/) |
|
| 23 |
+
| 02 | Arriella Grapevine: A Local Omni Multimodal Extension | cs.CV, cs.CL | [`02-grapevine/`](02-grapevine/) |
|
| 24 |
+
| 03 | Honest Capability Ingestion (Eat System) | cs.LG, cs.CL | [`03-eat-system/`](03-eat-system/) |
|
| 25 |
+
| 04 | Multimodal Routing for Text-Only Fleet Tiers | cs.CL, cs.CV | [`04-multimodal-routing/`](04-multimodal-routing/) |
|
| 26 |
+
| 05 | Arriella Fleet Evaluation Report | cs.CL | [`05-evaluation/`](05-evaluation/) |
|
| 27 |
+
| 06 | Fleet Internal Reasoning Wire Format | cs.CL | [`06-reasoning-format/`](06-reasoning-format/) |
|
| 28 |
+
| 07 | Model Interior Projection (MIP) | cs.HC, cs.LG | [`07-mip/`](07-mip/) |
|
| 29 |
+
|
| 30 |
+
Each folder: `paper.md`, `abstract.txt`, `metadata.yaml` (add `arxiv_id` / `hf_papers` after acceptance).
|
| 31 |
+
|
| 32 |
+
Sources merged from `docs/papers/`, `docs/guides/`, `docs/benchmarks/`, and `docs/archive/2026-07/`.
|
| 33 |
+
|
| 34 |
+
## Workflow
|
| 35 |
+
|
| 36 |
+
Detailed steps: [`SUBMISSION.md`](SUBMISSION.md)
|
| 37 |
+
|
| 38 |
+
```powershell
|
| 39 |
+
# 1) Build arXiv source zips
|
| 40 |
+
.\.venv\Scripts\python.exe scripts\package_arxiv.py
|
| 41 |
+
|
| 42 |
+
# 2) Upload each zip at https://arxiv.org/submit (human step)
|
| 43 |
+
|
| 44 |
+
# 3) After announcement, index on HF Papers
|
| 45 |
+
.\.venv\Scripts\python.exe scripts\index_hf_papers.py --arxiv-id YYYY.NNNNN --manuscript 01-fleet-factory
|
| 46 |
+
```
|
| 47 |
+
|
| 48 |
+
Packaged zips land in `docs/arxiv/submission-packages/` (gitignored if large; regenerate anytime).
|
| 49 |
+
|
| 50 |
+
## Stance rules
|
| 51 |
+
|
| 52 |
+
- Foundations are clay; Arriella products are factory outputs.
|
| 53 |
+
- Same-size open instruct competition only — no frontier parity claims.
|
| 54 |
+
- Scout under-recovered; Ascension not automatically smarter than Flagship.
|
| 55 |
+
- Grapevine is a multimodal **extension** (no Inkling weights).
|
| 56 |
+
- Prefer measured tables over slogans.
|
papers/SUBMISSION.md
ADDED
|
@@ -0,0 +1,63 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Submitting Arriella manuscripts to arXiv and Hugging Face Papers
|
| 2 |
+
|
| 3 |
+
## Why not Spaces or model repos?
|
| 4 |
+
|
| 5 |
+
- **Spaces** = runnable apps / demos.
|
| 6 |
+
- **Models** = weight checkpoints + model cards.
|
| 7 |
+
- **Papers** on Hugging Face = pages indexed from **arXiv** (`https://huggingface.co/papers/<arxiv-id>`).
|
| 8 |
+
|
| 9 |
+
There is no supported “upload a PDF as a Paper Page without arXiv” path.
|
| 10 |
+
|
| 11 |
+
## Step 1 — Package sources
|
| 12 |
+
|
| 13 |
+
```powershell
|
| 14 |
+
.\.venv\Scripts\python.exe scripts\package_arxiv.py
|
| 15 |
+
```
|
| 16 |
+
|
| 17 |
+
Creates `docs/arxiv/submission-packages/<manuscript>.zip` containing `paper.tex` (+ `abstract.txt`).
|
| 18 |
+
|
| 19 |
+
## Step 2 — Submit on arXiv
|
| 20 |
+
|
| 21 |
+
1. Log in at https://arxiv.org/submit
|
| 22 |
+
2. For each manuscript, use categories from that folder’s `metadata.yaml`
|
| 23 |
+
3. Upload the corresponding zip (Process with TeX)
|
| 24 |
+
4. Paste `abstract.txt` into the abstract field
|
| 25 |
+
5. Complete license / metadata and submit
|
| 26 |
+
|
| 27 |
+
Suggested order: **01-fleet-factory** → **02-grapevine** → **03-eat-system** → **05-evaluation** → shorter companions (04, 06, 07).
|
| 28 |
+
|
| 29 |
+
## Step 3 — Index on Hugging Face Papers
|
| 30 |
+
|
| 31 |
+
After the paper is announced (ID like `2607.01234`):
|
| 32 |
+
|
| 33 |
+
```powershell
|
| 34 |
+
.\.venv\Scripts\python.exe scripts\index_hf_papers.py --arxiv-id 2607.01234 --manuscript 01-fleet-factory
|
| 35 |
+
```
|
| 36 |
+
|
| 37 |
+
Or open `https://huggingface.co/papers/2607.01234` once to trigger indexing.
|
| 38 |
+
|
| 39 |
+
Then:
|
| 40 |
+
|
| 41 |
+
1. Open the paper page → claim authorship if listed
|
| 42 |
+
2. On future **model** repos, add the arXiv URL in the model card README so HF auto-tags `arxiv:<id>`
|
| 43 |
+
3. Optionally show the paper on your HF profile (Settings → Papers)
|
| 44 |
+
|
| 45 |
+
## Step 4 — Link models (when weights are published)
|
| 46 |
+
|
| 47 |
+
Model cards should cite papers like:
|
| 48 |
+
|
| 49 |
+
```markdown
|
| 50 |
+
Paper: https://arxiv.org/abs/YYYY.NNNNN
|
| 51 |
+
HF Papers: https://huggingface.co/papers/YYYY.NNNNN
|
| 52 |
+
```
|
| 53 |
+
|
| 54 |
+
Do **not** create model repos that contain only paper markdown.
|
| 55 |
+
|
| 56 |
+
## Local SoT
|
| 57 |
+
|
| 58 |
+
| Path | Role |
|
| 59 |
+
|------|------|
|
| 60 |
+
| `docs/arxiv/*/paper.md` | Editable manuscript source |
|
| 61 |
+
| `docs/arxiv/submission-packages/` | Generated LaTeX zips |
|
| 62 |
+
| `docs/archive/2026-07/` | Historical only |
|
| 63 |
+
| `docs/papers/` | Product whitepaper / drafts (not HF Paper Pages) |
|
whitepaper.md
ADDED
|
@@ -0,0 +1,163 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Arriella Fleet Whitepaper
|
| 2 |
+
|
| 3 |
+
**Scout · Growth · Flagship · Ascension — plus Grapevine multimodal & Model Interior Projection**
|
| 4 |
+
|
| 5 |
+
*Version 4.1 · July 2026*
|
| 6 |
+
|
| 7 |
+
**arXiv manuscripts (publication SoT):** [`../arxiv/`](../arxiv/) · submit via [`../arxiv/SUBMISSION.md`](../arxiv/SUBMISSION.md) → HF Papers after arXiv ID
|
| 8 |
+
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
## Read this first
|
| 12 |
+
|
| 13 |
+
Arriella is a **local training factory** that turns open instruct foundations into named small LMs you own on disk, plus a **Model Interior Projection (MIP)** viewer that makes inference inspectable in 3D — attention trails on a real parameter cloud, not a black-box chat box.
|
| 14 |
+
|
| 15 |
+
Organization: **Infinidev Corp** (Infinidev). Lead developers: **Beelzebub4888** and **Tcoder**.
|
| 16 |
+
|
| 17 |
+
### What problem we solve
|
| 18 |
+
|
| 19 |
+
1. Useful custom models on a consumer GPU (8 GB Blackwell, Windows)
|
| 20 |
+
2. **Role-scoped tiers** for field and business use — not one generic chatbot
|
| 21 |
+
3. Continuous improvement via **eat** (weight ingest / distill) and **grow** (post-deploy LoRA)
|
| 22 |
+
4. Stability knobs: enterprise base blend, capability/math/thinking anchors, gates before Ollama
|
| 23 |
+
5. A product nobody else ships: **live interior visualization of decode**
|
| 24 |
+
6. A separate **native multimodal** extension when text routing is not enough
|
| 25 |
+
|
| 26 |
+
### What “Arriella” means
|
| 27 |
+
|
| 28 |
+
| Sense | Meaning |
|
| 29 |
+
|-------|---------|
|
| 30 |
+
| Project | This repo — scripts, configs, `fleet/`, docs, MIP |
|
| 31 |
+
| Persona | System identity in datasets + chat |
|
| 32 |
+
| Dataset | `arriella_qa` (~90k Pile-derived Alpaca records) |
|
| 33 |
+
| Core products | `arriella-scout`, `arriella-growth`, `arriella-flagship`, `arriella-ascension` |
|
| 34 |
+
| Extension | `arriella-grapevine` (Omni multimodal — not a fifth core text model) |
|
| 35 |
+
|
| 36 |
+
Arriella is **not** a Meta/Alibaba/DeepSeek foundation model. Foundations are clay; products are what comes out of the factory.
|
| 37 |
+
|
| 38 |
+
---
|
| 39 |
+
|
| 40 |
+
## Product thesis — stable models for fields & business
|
| 41 |
+
|
| 42 |
+
Enterprise and field deployments fail when a single mid-size chat model is asked to be edge-fast, domain-deep, reason-heavy, and multimodal at once. Arriella ships **specialists with shared factory discipline**:
|
| 43 |
+
|
| 44 |
+
| Need | Route to | Why |
|
| 45 |
+
|------|----------|-----|
|
| 46 |
+
| Low VRAM / high throughput | Scout | Smallest core text tier |
|
| 47 |
+
| Domain QA / continuation | Growth | Trained on full Arriella QA pile |
|
| 48 |
+
| General instruction ops | Flagship | Heretic + premium teacher distill |
|
| 49 |
+
| Explicit step-by-step reasoning | Ascension | DeepSeek-R1 distill native think |
|
| 50 |
+
| Image / audio in the loop | Grapevine | Qwen2.5-Omni-3B student |
|
| 51 |
+
|
| 52 |
+
Reliability comes from **gates and anchors**, not slogans: capability / math / thinking / identity / fleet-spec datasets, optional enterprise base blend (~8–15% foundation retention), bakeoffs vs same-size stock instruct, and honest modality claims.
|
| 53 |
+
|
| 54 |
+
---
|
| 55 |
+
|
| 56 |
+
## Fleet tiers (Jul 2026 stance)
|
| 57 |
+
|
| 58 |
+
### Core text fleet (exactly four)
|
| 59 |
+
|
| 60 |
+
| Tier | Size (Ollama) | Foundation | Training path | Product stance |
|
| 61 |
+
|------|---------------|------------|---------------|----------------|
|
| 62 |
+
| **Flagship** | ~1.5B | Qwen2.5-1.5B-Instruct | Heretic → premium QLoRA distill | Primary quality / general ops |
|
| 63 |
+
| **Growth** | ~1.2B | Llama-3.2-1B-Instruct | LLaMA-Factory on `arriella_qa` | Primary mid / domain tier |
|
| 64 |
+
| **Ascension** | ~1.8B | DeepSeek-R1-Distill-Qwen-1.5B | LLaMA-Factory + Flagship catch-up | Reasoning / native think — **not** automatically smarter than Flagship |
|
| 65 |
+
| **Scout** | ~494M | Qwen2.5-0.5B-Instruct | Heretic → QLoRA | Present but **currently underpowered** — edge experiments, not demos |
|
| 66 |
+
|
| 67 |
+
Canonical numbers and truth rules: [`fleet/CORE_FLEET_SPEC.md`](../../fleet/CORE_FLEET_SPEC.md). Benchmarks: [../benchmarks/README.md](../benchmarks/README.md).
|
| 68 |
+
|
| 69 |
+
### Multimodal extension (not core text)
|
| 70 |
+
|
| 71 |
+
| Product | Foundation | Stance |
|
| 72 |
+
|---------|------------|--------|
|
| 73 |
+
| **Grapevine** | Qwen2.5-Omni-3B | Technical preview for vision/audio; modular runtime LoRA + mmproj. Inkling is a capability target only — no Inkling weights. |
|
| 74 |
+
|
| 75 |
+
Guide: [../guides/grapevine.md](../guides/grapevine.md). HF draft: [grapevine-hf.md](grapevine-hf.md).
|
| 76 |
+
|
| 77 |
+
---
|
| 78 |
+
|
| 79 |
+
## Training framework
|
| 80 |
+
|
| 81 |
+
```
|
| 82 |
+
foundation HF weights
|
| 83 |
+
├─ Path A (Scout / Flagship): Heretic abliteration → QLoRA distill → merge
|
| 84 |
+
├─ Path B (Growth / Ascension): LLaMA-Factory LoRA → merge
|
| 85 |
+
└─ Path C (Grapevine): Omni Thinker QLoRA → merge / runtime adapter → GGUF + mmproj
|
| 86 |
+
↓
|
| 87 |
+
fleet/<tier>/model/ (standalone HF) | fleet/inkling/ (Grapevine)
|
| 88 |
+
↓
|
| 89 |
+
enterprise base blend (optional) + capability / fleet-spec anchors
|
| 90 |
+
↓
|
| 91 |
+
optional eat (weight ingest / distill) + post-deploy grow
|
| 92 |
+
↓
|
| 93 |
+
GGUF → ollama run arriella-*
|
| 94 |
+
```
|
| 95 |
+
|
| 96 |
+
**Heretic** abliterates refusal directions (not fine-tuning). Distillation then teaches what to say under QLoRA.
|
| 97 |
+
|
| 98 |
+
**Pufferfish** in this repo is the **long-run policy / WebUI preset layer** (`fleet_pufferfish.py`, `arriella_integration/`), not the upstream LightLM trainer as the primary engine.
|
| 99 |
+
|
| 100 |
+
Orchestrator: `scripts/train_fleet.py` + `fleet/fleet_manifest.yaml`.
|
| 101 |
+
|
| 102 |
+
---
|
| 103 |
+
|
| 104 |
+
## Eat & grow
|
| 105 |
+
|
| 106 |
+
After merge, capabilities improve by:
|
| 107 |
+
|
| 108 |
+
- **Weight ingest** — same-arch tensor merge (linear / TIES / DARE-TIES / …)
|
| 109 |
+
- **Distill grow** — cross-architecture teacher imitation (prefer larger teachers)
|
| 110 |
+
- **Organic grow** — post-deploy LoRA on anchors / datasets
|
| 111 |
+
- **Enterprise align** — base-preservation blend + capability re-eval (`fleet_enterprise_align.py`)
|
| 112 |
+
|
| 113 |
+
Honest language SoT: [../guides/eat-system.md](../guides/eat-system.md).
|
| 114 |
+
|
| 115 |
+
---
|
| 116 |
+
|
| 117 |
+
## MIP — Model Interior Projection
|
| 118 |
+
|
| 119 |
+
MIP loads a HF/Ollama-backed checkpoint, samples parameter space into ≤120k GPU display points, and during decode:
|
| 120 |
+
|
| 121 |
+
- Paints prompt-specific attention / residual activity on the cloud
|
| 122 |
+
- Traces a gold polyline (one node per generated token)
|
| 123 |
+
- Forges a deterministic projected **tesseract** from that trail
|
| 124 |
+
- Can **repeat** a prompt N times and **compare** solids (seed, tokens, geometry)
|
| 125 |
+
|
| 126 |
+
Guide: [../guides/mip-viewer.md](../guides/mip-viewer.md). Entry: `scripts/fleet_mip_web.py`.
|
| 127 |
+
|
| 128 |
+
This is the differentiator. Chat UIs show tokens. MIP shows **where** attention landed in the model’s own geometry.
|
| 129 |
+
|
| 130 |
+
---
|
| 131 |
+
|
| 132 |
+
## Multimodal (honest)
|
| 133 |
+
|
| 134 |
+
**Core text tiers** do not ingest raw pixels on 8 GB. Images go Gemma3 → categorized text → fleet model. Thinking/vision behaviors are **ingested** via teacher traces.
|
| 135 |
+
|
| 136 |
+
**Grapevine** is the native Omni path (text + image + audio in Ollama; video validated pre-export). Details: [multimodal.md](multimodal.md), [../guides/grapevine.md](../guides/grapevine.md).
|
| 137 |
+
|
| 138 |
+
---
|
| 139 |
+
|
| 140 |
+
## Competitive posture
|
| 141 |
+
|
| 142 |
+
- Compete with **same-size open instruct** checkpoints via bakeoffs.
|
| 143 |
+
- Do not claim frontier closed-model parity.
|
| 144 |
+
- Prefer measured tables in `docs/benchmarks/` over slogans.
|
| 145 |
+
- Prefer **role fit** (field/business job) over “one model to rule them all.”
|
| 146 |
+
|
| 147 |
+
---
|
| 148 |
+
|
| 149 |
+
## Publication (arXiv → Hugging Face Papers)
|
| 150 |
+
|
| 151 |
+
- Manuscript set: [`../arxiv/`](../arxiv/)
|
| 152 |
+
- Workflow: [`../arxiv/SUBMISSION.md`](../arxiv/SUBMISSION.md)
|
| 153 |
+
- Hub guide: [`../guides/hugging-face-publish.md`](../guides/hugging-face-publish.md)
|
| 154 |
+
|
| 155 |
+
Do **not** host papers as Spaces or model-only-markdown repos. Spaces are for runnable demos; Paper Pages require arXiv IDs.
|
| 156 |
+
|
| 157 |
+
---
|
| 158 |
+
|
| 159 |
+
## Document history
|
| 160 |
+
|
| 161 |
+
- v2.5 — fleet narrative without MIP as product centerpiece (`docs/archive/2026-07/WHITEPAPER.md`)
|
| 162 |
+
- v3.0 — reorganized docs; MIP as unique product; honest Scout status; three-tier only
|
| 163 |
+
- v4.0 — four-core text fleet + Grapevine extension; field/business thesis; HF paper prep
|