Spaces:
Running
Running
r1cksync commited on
Commit Β·
c5cb009
1
Parent(s): 4baed7b
blog: inline ENV_DEEP/ENV_SHALLOW/TASKS_SHALLOW into BLOG.md (deep first); voice: tour deep regime in scene04
Browse filesBLOG.md is now self-contained: full per-task / per-action / per-reward spec for both regimes (deep + shallow) plus the 381-task index, ordered deep first because Round 1+2 results validated the rubric. voice/auto_demo.py scene04 now scrolls through every #deep subsection on the showcase before landing on #results.
- BLOG.md +0 -0
- voice/auto_demo.py +13 -8
- voice/scene04.txt +1 -1
BLOG.md
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|
voice/auto_demo.py
CHANGED
|
@@ -140,14 +140,19 @@ SCENES = {
|
|
| 140 |
(19.0, lambda p: _hover(p, "#slack .codeblock", 1)),
|
| 141 |
(22.0, lambda p: _scroll_to(p, "#slack .mermaid-frame", block="center")),
|
| 142 |
],
|
| 143 |
-
"scene04": [ #
|
| 144 |
-
(0.0,
|
| 145 |
-
(
|
| 146 |
-
(
|
| 147 |
-
(
|
| 148 |
-
(
|
| 149 |
-
(
|
| 150 |
-
(
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 151 |
],
|
| 152 |
"scene05": [ # Hyper-parameters
|
| 153 |
(0.0, lambda p: _scroll_to(p, "#training", block="end")),
|
|
|
|
| 140 |
(19.0, lambda p: _hover(p, "#slack .codeblock", 1)),
|
| 141 |
(22.0, lambda p: _scroll_to(p, "#slack .mermaid-frame", block="center")),
|
| 142 |
],
|
| 143 |
+
"scene04": [ # Deep regime tour + shallow learning evidence
|
| 144 |
+
(0.0, lambda p: _scroll_to(p, "#deep")),
|
| 145 |
+
(5.0, lambda p: _scroll_to(p, "#deep table", block="center")), # 11-archetype table
|
| 146 |
+
(14.0, lambda p: _scroll_px(p, 380)), # Round 1 SB3 floor
|
| 147 |
+
(24.0, lambda p: _scroll_px(p, 420)), # Round 2 critic ladder
|
| 148 |
+
(38.0, lambda p: _scroll_px(p, 420)), # Per-task delta table
|
| 149 |
+
(52.0, lambda p: _scroll_px(p, 420)), # Optimisation-side cards
|
| 150 |
+
(66.0, lambda p: _scroll_px(p, 380)), # TL;DR card
|
| 151 |
+
(74.0, lambda p: _scroll_to(p, "#results")),
|
| 152 |
+
(80.0, lambda p: _hover(p, "#results .grid-2 .card", 0)),
|
| 153 |
+
(87.0, lambda p: _hover(p, "#results .grid-2 .card", 1)),
|
| 154 |
+
(94.0, lambda p: _scroll_to(p, "#results table", block="center")),
|
| 155 |
+
(100.0, lambda p: _hover(p, "#results table tbody tr", 2)),
|
| 156 |
],
|
| 157 |
"scene05": [ # Hyper-parameters
|
| 158 |
(0.0, lambda p: _scroll_to(p, "#training", block="end")),
|
voice/scene04.txt
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
Did it learn?
|
|
|
|
| 1 |
+
Did it actually learn? The cleanest evidence isn't on the 381-task run β it's in the deep regime that came before it. Eleven hand-curated archetypes, three full PPO rounds, every metric audited. Round one: stable-baselines PPO with a one-twenty-eight by one-twenty-eight MLP on the three hardest tasks. Hits a one point zero five mean reward and a hundred percent success rate by eighty thousand steps. That's the floor β proof the env is solvable end-to-end. Round two keeps the env, swaps in a small-LLM actor, and runs three different critics back-to-back. Mean reward climbs from one point one seven on the heuristic baseline, to one point three two with an Ollama plus Bedrock judge, to one point seven eight on a Groq Llama three point one critic. Plus fifty-two percent from the same env, just smarter feedback. Every single one of the eleven archetypes improves. Median plus forty-nine percent. Liveness probe and image pull backoff jump over seventy. On the optimisation side, policy loss collapses ninety-three percent on the heuristic run, fifty-five percent in just twelve updates on the LLM run. That's the rubric we then scaled to 381 tasks on. And on the shallow regime β KL drops over fifty percent across all three shards. Loss roughly halves. All three shards converge on the exact same peak reward β minus zero point three one five. The novelty categories β Slack red herring, runbook trap, cascading failure β those are the ones that actually improved.
|