sum-guy-429 commited on
Commit
d67860b
·
verified ·
1 Parent(s): 61b0f63

docs: add Space README body for Governance Bench

Browse files
Files changed (1) hide show
  1. README.md +87 -0
README.md CHANGED
@@ -9,3 +9,90 @@ pinned: false
9
  license: apache-2.0
10
  short_description: Interactive benchmark for AI agent governance primitives
11
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  license: apache-2.0
10
  short_description: Interactive benchmark for AI agent governance primitives
11
  ---
12
+
13
+ # Governance-Bench Agent Reasoning Audit
14
+
15
+ Interactive demo for **HUMMBL Governance Bench** — a Harbor-compatible benchmark that tests **operational AI agent governance** (what agents *do*), not content safety (what models *say*). The Space browses the 70-task suite, shows Base120 governance mental models, runs task verification scripts, and surfaces dimension scores.
16
+
17
+ **Live app:** [hummbl-research-governance-bench-space.hf.space](https://hummbl-research-governance-bench-space.hf.space)
18
+
19
+ ## Links
20
+
21
+ | Resource | URL |
22
+ |----------|-----|
23
+ | Dataset | [hummbl-hf/governance-bench](https://huggingface.co/datasets/hummbl-hf/governance-bench) |
24
+ | Collection | [hummbl-research/hummbl-governance-bench](https://huggingface.co/collections/hummbl-research/hummbl-governance-bench-6a799d546ec60e99c82528cf) |
25
+ | Org | [hummbl-research](https://huggingface.co/hummbl-research) |
26
+
27
+ The benchmark dataset lives on the sister org **hummbl-hf**; this Space (Docker SDK) is published under **hummbl-research**.
28
+
29
+ ## What this Space does
30
+
31
+ A FastAPI + uvicorn + Jinja2 UI over the baked-in benchmark checkout (`BENCH_ROOT=/bench`):
32
+
33
+ 1. **Overview** — task counts by category and difficulty; Base120 model cards
34
+ 2. **Tasks** — browse by category, read `instruction.md`, inspect metadata (`difficulty`, scoring model)
35
+ 3. **Run Verification** — execute each task’s `tests/verify.py` and show overall score plus four dimensions (correctness, governance awareness, safety–utility tradeoff, audit trail quality)
36
+ 4. **Base120 Models** — seven governance mental models mapped to primitives (e.g. interruptibility → KillSwitch / CircuitBreaker)
37
+ 5. **Leaderboard** — reads agent result JSON from `BENCH_ROOT/results` when present
38
+
39
+ JSON APIs: `GET /api/tasks`, `GET /api/task/{category}/{task_id}`, `POST /api/task/{category}/{task_id}/run`, `GET /api/base120/models`, `GET /api/leaderboard`, `GET /health`.
40
+
41
+ ### How to use
42
+
43
+ 1. Open the live Space (or run locally — see below).
44
+ 2. On **Overview**, click a category card to open the task browser.
45
+ 3. Select a task to read the instruction and Base120 analysis.
46
+ 4. Click **Run Verification** to execute the task’s verify script and view scores.
47
+
48
+ ## Task categories (7 × 10 = 70)
49
+
50
+ | Category | What it tests |
51
+ |----------|----------------|
52
+ | `kill_switch` | Emergency halt, mode transitions, critical task exemptions |
53
+ | `circuit_breaker` | Failure detection, state transitions, recovery |
54
+ | `delegation_chains` | HMAC-signed tokens, scope narrowing, depth limits |
55
+ | `authority_boundaries` | Authority-class validation, DCT cross-links, hash chains |
56
+ | `taint_tracking` | Data provenance, propagation, sink policy enforcement |
57
+ | `execution_boundary` | Fail-closed behavior, risk scoring, path restrictions |
58
+ | `behavioral_drift` | Reward gaming, convergence detection, drift quantification |
59
+
60
+ Difficulty mix (dataset card): 21 easy, 28 medium, 21 hard. Each task is Harbor `task.toml` v1.3 compatible (`task.toml`, `instruction.md`, environment Dockerfile, verification script).
61
+
62
+ ## Runtime & local / Docker notes
63
+
64
+ - **SDK:** Docker; app listens on port **7860**
65
+ - **Stack:** FastAPI, uvicorn, Jinja2; depends on `hummbl-governance>=1.1.0`
66
+ - **Data:** Dataset snapshot is fetched at **image build time** into `/bench` (immutable; updates require a rebuild — intentional supply-chain hardening vs. runtime fetch)
67
+ - **Env:** `BENCH_ROOT=/bench` (override for local mounts)
68
+
69
+ ```bash
70
+ # From this Space repo
71
+ docker build -t governance-bench-space .
72
+ docker run --rm -p 7860:7860 governance-bench-space
73
+ # Then open http://localhost:7860
74
+ ```
75
+
76
+ Local (without Docker), after installing `requirements.txt` and pointing at a local dataset checkout:
77
+
78
+ ```bash
79
+ export BENCH_ROOT=/path/to/governance-bench # must contain tasks/
80
+ uvicorn app:app --host 0.0.0.0 --port 7860
81
+ ```
82
+
83
+ For full agent evaluation against the dataset (outside this Space), see the dataset card’s Harbor usage examples.
84
+
85
+ ## License & credit
86
+
87
+ - **This Space:** Apache-2.0 (YAML `license`)
88
+ - **Dataset:** CC-BY-4.0 with evaluation-only restriction (not for training / fine-tuning) — see [dataset card](https://huggingface.co/datasets/hummbl-hf/governance-bench)
89
+ - **Credit:** HUMMBL, LLC — HUMMBL Governance Bench
90
+
91
+ ```bibtex
92
+ @dataset{hummbl2026governancebench,
93
+ title={HUMMBL Governance Bench: First Benchmark for Operational AI Agent Governance},
94
+ author={HUMMBL, LLC},
95
+ year={2026},
96
+ url={https://huggingface.co/datasets/hummbl-hf/governance-bench}
97
+ }
98
+ ```