Reproduction guide
This directory contains the necessary information and assets to reproduce the results obtained during this Heretic run.
Local code
This system installed Heretic from a local directory or wheel. Uncommitted or experimental code may have been executed.
Reproducibility cannot be guaranteed in this environment.
Models
- Base model: TheDrummer/Artemis-31B-v1.1 (Commit:
d613e5a)
Datasets
- Good prompts: mlabonne/harmless_alpaca (Commit:
02c6a92) - Bad prompts: mlabonne/harmful_behaviors (Commit:
01cead0)
Selected trial
- Trial number: 150
- Refusals: 30/100 (baseline: 90/100)
- KL divergence: 0.0083 (baseline: 0 (by definition))
Environment
- Heretic: v2.0.0.dev0 (Origin: Local)
- PyTorch: 2.12.0+cu130
- Other dependencies: See
requirements.txt.
Contents of this directory
requirements.txt: The exact versions of all Python packages.config.toml: The exact configuration used, including the RNG seed.TheDrummer--Artemis-31B-v1--1.jsonl: The Optuna study journal containing the history of all trials.SHA256SUMS: Cryptographic hashes for all weight files.reproduce.json: A machine-readable file containing all reproducibility information.
How to reproduce
You can automate this process, including all verification steps, by downloading the
reproduce.jsonfile and runningheretic --reproduce reproduce.json.
- Install the exact version of Heretic indicated in the Environment section above, from its original source.
- Install the packages listed in
requirements.txt:pip install -r requirements.txt - Install the correct version of PyTorch:
pip install torch==2.12.0+cu130 --index-url https://download.pytorch.org/whl/cu130 - Place the provided
config.tomlin your working directory. - Run Heretic without any additional arguments:
heretic - Wait for the run to finish, then select trial 150 and export the model.
- Verify that the weight files have been exactly reproduced by comparing their SHA-256 hashes against those in
SHA256SUMS:sha256sum -c SHA256SUMS(or look at the hashes online if you uploaded to Hugging Face)
To use the included Optuna study journal
TheDrummer--Artemis-31B-v1--1.jsonl, place it in the checkpoints directory (usuallycheckpoints/) before running Heretic.This allows you to export other models from the Pareto front, or to run additional trials without having to re-run the stored trials.