chane35's picture
PERMANENCE: reversibility-aware RL environment for training LLM agents
f684b80 verified
|
Raw
History Blame
892 Bytes

Results Folder Notes

This folder contains the main evaluation outputs for the submission.

Domain scope clarification

The primary judged focus is the DevTools domain (filesystem/git/database). You may still see Meridian-related labels in some artifacts:

  • track=meridian_transfer in comparison.csv
  • n_scenarios_meridian in results.json

These indicate a secondary cross-domain transfer slice kept for architecture completeness. The headline reported metrics are based on the DevTools track (track=tech).

File guide

  • comparison.csv: per-scenario rows across policies; includes both tech and meridian_transfer tracks.
  • results.json: per-policy summary counters and means.
  • summary.txt: human-readable evaluation summary.
  • training_log.json: episode-level training log.
  • *.png: plots and confusion matrix used in docs/README.