docs: add Space README body for Governance Bench
Browse files
README.md
CHANGED
|
@@ -9,3 +9,90 @@ pinned: false
|
|
| 9 |
license: apache-2.0
|
| 10 |
short_description: Interactive benchmark for AI agent governance primitives
|
| 11 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 9 |
license: apache-2.0
|
| 10 |
short_description: Interactive benchmark for AI agent governance primitives
|
| 11 |
---
|
| 12 |
+
|
| 13 |
+
# Governance-Bench Agent Reasoning Audit
|
| 14 |
+
|
| 15 |
+
Interactive demo for **HUMMBL Governance Bench** — a Harbor-compatible benchmark that tests **operational AI agent governance** (what agents *do*), not content safety (what models *say*). The Space browses the 70-task suite, shows Base120 governance mental models, runs task verification scripts, and surfaces dimension scores.
|
| 16 |
+
|
| 17 |
+
**Live app:** [hummbl-research-governance-bench-space.hf.space](https://hummbl-research-governance-bench-space.hf.space)
|
| 18 |
+
|
| 19 |
+
## Links
|
| 20 |
+
|
| 21 |
+
| Resource | URL |
|
| 22 |
+
|----------|-----|
|
| 23 |
+
| Dataset | [hummbl-hf/governance-bench](https://huggingface.co/datasets/hummbl-hf/governance-bench) |
|
| 24 |
+
| Collection | [hummbl-research/hummbl-governance-bench](https://huggingface.co/collections/hummbl-research/hummbl-governance-bench-6a799d546ec60e99c82528cf) |
|
| 25 |
+
| Org | [hummbl-research](https://huggingface.co/hummbl-research) |
|
| 26 |
+
|
| 27 |
+
The benchmark dataset lives on the sister org **hummbl-hf**; this Space (Docker SDK) is published under **hummbl-research**.
|
| 28 |
+
|
| 29 |
+
## What this Space does
|
| 30 |
+
|
| 31 |
+
A FastAPI + uvicorn + Jinja2 UI over the baked-in benchmark checkout (`BENCH_ROOT=/bench`):
|
| 32 |
+
|
| 33 |
+
1. **Overview** — task counts by category and difficulty; Base120 model cards
|
| 34 |
+
2. **Tasks** — browse by category, read `instruction.md`, inspect metadata (`difficulty`, scoring model)
|
| 35 |
+
3. **Run Verification** — execute each task’s `tests/verify.py` and show overall score plus four dimensions (correctness, governance awareness, safety–utility tradeoff, audit trail quality)
|
| 36 |
+
4. **Base120 Models** — seven governance mental models mapped to primitives (e.g. interruptibility → KillSwitch / CircuitBreaker)
|
| 37 |
+
5. **Leaderboard** — reads agent result JSON from `BENCH_ROOT/results` when present
|
| 38 |
+
|
| 39 |
+
JSON APIs: `GET /api/tasks`, `GET /api/task/{category}/{task_id}`, `POST /api/task/{category}/{task_id}/run`, `GET /api/base120/models`, `GET /api/leaderboard`, `GET /health`.
|
| 40 |
+
|
| 41 |
+
### How to use
|
| 42 |
+
|
| 43 |
+
1. Open the live Space (or run locally — see below).
|
| 44 |
+
2. On **Overview**, click a category card to open the task browser.
|
| 45 |
+
3. Select a task to read the instruction and Base120 analysis.
|
| 46 |
+
4. Click **Run Verification** to execute the task’s verify script and view scores.
|
| 47 |
+
|
| 48 |
+
## Task categories (7 × 10 = 70)
|
| 49 |
+
|
| 50 |
+
| Category | What it tests |
|
| 51 |
+
|----------|----------------|
|
| 52 |
+
| `kill_switch` | Emergency halt, mode transitions, critical task exemptions |
|
| 53 |
+
| `circuit_breaker` | Failure detection, state transitions, recovery |
|
| 54 |
+
| `delegation_chains` | HMAC-signed tokens, scope narrowing, depth limits |
|
| 55 |
+
| `authority_boundaries` | Authority-class validation, DCT cross-links, hash chains |
|
| 56 |
+
| `taint_tracking` | Data provenance, propagation, sink policy enforcement |
|
| 57 |
+
| `execution_boundary` | Fail-closed behavior, risk scoring, path restrictions |
|
| 58 |
+
| `behavioral_drift` | Reward gaming, convergence detection, drift quantification |
|
| 59 |
+
|
| 60 |
+
Difficulty mix (dataset card): 21 easy, 28 medium, 21 hard. Each task is Harbor `task.toml` v1.3 compatible (`task.toml`, `instruction.md`, environment Dockerfile, verification script).
|
| 61 |
+
|
| 62 |
+
## Runtime & local / Docker notes
|
| 63 |
+
|
| 64 |
+
- **SDK:** Docker; app listens on port **7860**
|
| 65 |
+
- **Stack:** FastAPI, uvicorn, Jinja2; depends on `hummbl-governance>=1.1.0`
|
| 66 |
+
- **Data:** Dataset snapshot is fetched at **image build time** into `/bench` (immutable; updates require a rebuild — intentional supply-chain hardening vs. runtime fetch)
|
| 67 |
+
- **Env:** `BENCH_ROOT=/bench` (override for local mounts)
|
| 68 |
+
|
| 69 |
+
```bash
|
| 70 |
+
# From this Space repo
|
| 71 |
+
docker build -t governance-bench-space .
|
| 72 |
+
docker run --rm -p 7860:7860 governance-bench-space
|
| 73 |
+
# Then open http://localhost:7860
|
| 74 |
+
```
|
| 75 |
+
|
| 76 |
+
Local (without Docker), after installing `requirements.txt` and pointing at a local dataset checkout:
|
| 77 |
+
|
| 78 |
+
```bash
|
| 79 |
+
export BENCH_ROOT=/path/to/governance-bench # must contain tasks/
|
| 80 |
+
uvicorn app:app --host 0.0.0.0 --port 7860
|
| 81 |
+
```
|
| 82 |
+
|
| 83 |
+
For full agent evaluation against the dataset (outside this Space), see the dataset card’s Harbor usage examples.
|
| 84 |
+
|
| 85 |
+
## License & credit
|
| 86 |
+
|
| 87 |
+
- **This Space:** Apache-2.0 (YAML `license`)
|
| 88 |
+
- **Dataset:** CC-BY-4.0 with evaluation-only restriction (not for training / fine-tuning) — see [dataset card](https://huggingface.co/datasets/hummbl-hf/governance-bench)
|
| 89 |
+
- **Credit:** HUMMBL, LLC — HUMMBL Governance Bench
|
| 90 |
+
|
| 91 |
+
```bibtex
|
| 92 |
+
@dataset{hummbl2026governancebench,
|
| 93 |
+
title={HUMMBL Governance Bench: First Benchmark for Operational AI Agent Governance},
|
| 94 |
+
author={HUMMBL, LLC},
|
| 95 |
+
year={2026},
|
| 96 |
+
url={https://huggingface.co/datasets/hummbl-hf/governance-bench}
|
| 97 |
+
}
|
| 98 |
+
```
|