bestdive/APPO-doom_health_gathering_supreme

APPO Doom Health Gathering Supreme

Trained from random initialization by Kay Zheng (bestdive), with AI coding and execution assistance, for the Hugging Face Deep RL course Unit 8 Part II. No pretrained policy was copied and no evaluation metric was fabricated. Training used a free Colab T4 GPU, seed 42 and 4,005,888 environment frames.

Independent evaluation

100 complete episodes in a separately seeded environment (100001), deterministic actions, latest final checkpoint. Mean reward 11.787799999999942, population standard deviation 5.578349501420757. The course score is 6.209450498579185 (required minimum 5).

These are the true-objective episode returns collected in Sample Factory's official enjoyment/evaluation function and used by its model-card generator. We do not substitute the higher shaped training reward. Every return is in evaluation.json. The exact checkpoint loaded is independently recorded in doom-evaluation.log.

Reproduction

Python 3.10.12, sample-factory==2.1.1, vizdoom==1.2.4, torch==2.2.2, numpy<2, setuptools<81. Registration and training code comes from the official Hugging Face Unit 8 Part II notebook, with explicit experiment arguments. train_doom.py and evaluate_doom.py contain the executed code.

For inference, place this repository under /content/doom-results/Kay-Doom, copy train_doom.py and evaluate_doom.py into /content, then run evaluate_doom.py. The checkpoint must be in checkpoint_p0/. Training from scratch runs train_doom.py. Change the explicit paths in both scripts for another workspace.

This model is limited to this simulated environment and is not evidence of general AI competence.