r1cksync commited on
Commit
c5cb009
Β·
1 Parent(s): 4baed7b

blog: inline ENV_DEEP/ENV_SHALLOW/TASKS_SHALLOW into BLOG.md (deep first); voice: tour deep regime in scene04

Browse files

BLOG.md is now self-contained: full per-task / per-action / per-reward spec for both regimes (deep + shallow) plus the 381-task index, ordered deep first because Round 1+2 results validated the rubric. voice/auto_demo.py scene04 now scrolls through every #deep subsection on the showcase before landing on #results.

Files changed (3) hide show
  1. BLOG.md +0 -0
  2. voice/auto_demo.py +13 -8
  3. voice/scene04.txt +1 -1
BLOG.md CHANGED
The diff for this file is too large to render. See raw diff
 
voice/auto_demo.py CHANGED
@@ -140,14 +140,19 @@ SCENES = {
140
  (19.0, lambda p: _hover(p, "#slack .codeblock", 1)),
141
  (22.0, lambda p: _scroll_to(p, "#slack .mermaid-frame", block="center")),
142
  ],
143
- "scene04": [ # "Did it actually learn?" + Results
144
- (0.0, lambda p: _scroll_to(p, "#training")),
145
- (4.0, lambda p: _scroll_to(p, "#results")),
146
- (4.5, lambda p: _hover(p, "#results .grid-2 .card", 0)),
147
- (9.0, lambda p: _hover(p, "#results .grid-2 .card", 1)),
148
- (14.0, lambda p: _scroll_to(p, "#results table", block="center")),
149
- (19.0, lambda p: _hover(p, "#results table tbody tr", 2)),
150
- (23.0, lambda p: _scroll_to(p, "#results .grid-3", block="center")),
 
 
 
 
 
151
  ],
152
  "scene05": [ # Hyper-parameters
153
  (0.0, lambda p: _scroll_to(p, "#training", block="end")),
 
140
  (19.0, lambda p: _hover(p, "#slack .codeblock", 1)),
141
  (22.0, lambda p: _scroll_to(p, "#slack .mermaid-frame", block="center")),
142
  ],
143
+ "scene04": [ # Deep regime tour + shallow learning evidence
144
+ (0.0, lambda p: _scroll_to(p, "#deep")),
145
+ (5.0, lambda p: _scroll_to(p, "#deep table", block="center")), # 11-archetype table
146
+ (14.0, lambda p: _scroll_px(p, 380)), # Round 1 SB3 floor
147
+ (24.0, lambda p: _scroll_px(p, 420)), # Round 2 critic ladder
148
+ (38.0, lambda p: _scroll_px(p, 420)), # Per-task delta table
149
+ (52.0, lambda p: _scroll_px(p, 420)), # Optimisation-side cards
150
+ (66.0, lambda p: _scroll_px(p, 380)), # TL;DR card
151
+ (74.0, lambda p: _scroll_to(p, "#results")),
152
+ (80.0, lambda p: _hover(p, "#results .grid-2 .card", 0)),
153
+ (87.0, lambda p: _hover(p, "#results .grid-2 .card", 1)),
154
+ (94.0, lambda p: _scroll_to(p, "#results table", block="center")),
155
+ (100.0, lambda p: _hover(p, "#results table tbody tr", 2)),
156
  ],
157
  "scene05": [ # Hyper-parameters
158
  (0.0, lambda p: _scroll_to(p, "#training", block="end")),
voice/scene04.txt CHANGED
@@ -1 +1 @@
1
- Did it learn? Yes. The legacy MLP baseline solves the easy version perfectly. Our LLM agent runs the same env on hard mode. KL drops over fifty percent. Loss the same. All three shards converge on the exact same peak reward. And the novelty categories β€” Slack red herring, runbook trap, cascading failure β€” those are the ones that actually improved.
 
1
+ Did it actually learn? The cleanest evidence isn't on the 381-task run β€” it's in the deep regime that came before it. Eleven hand-curated archetypes, three full PPO rounds, every metric audited. Round one: stable-baselines PPO with a one-twenty-eight by one-twenty-eight MLP on the three hardest tasks. Hits a one point zero five mean reward and a hundred percent success rate by eighty thousand steps. That's the floor β€” proof the env is solvable end-to-end. Round two keeps the env, swaps in a small-LLM actor, and runs three different critics back-to-back. Mean reward climbs from one point one seven on the heuristic baseline, to one point three two with an Ollama plus Bedrock judge, to one point seven eight on a Groq Llama three point one critic. Plus fifty-two percent from the same env, just smarter feedback. Every single one of the eleven archetypes improves. Median plus forty-nine percent. Liveness probe and image pull backoff jump over seventy. On the optimisation side, policy loss collapses ninety-three percent on the heuristic run, fifty-five percent in just twelve updates on the LLM run. That's the rubric we then scaled to 381 tasks on. And on the shallow regime β€” KL drops over fifty percent across all three shards. Loss roughly halves. All three shards converge on the exact same peak reward β€” minus zero point three one five. The novelty categories β€” Slack red herring, runbook trap, cascading failure β€” those are the ones that actually improved.