Update README with comprehensive model documentation including distillation students
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ A multi-model neural rendering pipeline designed for real-time game graphics, tr
|
|
| 16 |
|
| 17 |
The Uruk Neural Renderer is organized into a multi-workstream pipeline, where each workstream trains a specialized model family. A policy-compliant orchestrator manages the 4-stage training lifecycle: **Smoke** (bug-catching), **Calibration** (hyperparameter tuning), **Production** (full training with early stopping), and **Distillation** (teacher-to-student compression).
|
| 18 |
|
| 19 |
-
The flagship **V2-Ultra** model uses a 32-channel input (including a 12-channel G-buffer with material IDs, depth, and normals) and achieves **94.6% material accuracy** — enabling physically-correct lighting decisions based on ground-truth geometry rather than screen-space inference.
|
| 20 |
|
| 21 |
## Models
|
| 22 |
|
|
@@ -54,6 +54,20 @@ Best checkpoints from the policy-compliant orchestrator production runs.
|
|
| 54 |
| `workstreams/ws6_runtime_optimization_v2/ws6_v2_best.pt` | WS6 v2 — Runtime Optimization (rerun) | Completed all 500 epochs | 13.7 MB |
|
| 55 |
| `workstreams/ws7_scene_to_world_v2/ws7_v2_best.pt` | WS7 v2 — Scene to World | Graph-based scene understanding | 43.7 MB |
|
| 56 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
### Additional Models
|
| 58 |
|
| 59 |
| File | Description | Size |
|
|
@@ -63,15 +77,9 @@ Best checkpoints from the policy-compliant orchestrator production runs.
|
|
| 63 |
| `ws8_structure_generator/best_model.pt` | WS8 — Structure Generator | 32.4 MB |
|
| 64 |
| `onnx/npc_director.onnx` | NPC Director ONNX export | 5.1 MB |
|
| 65 |
|
| 66 |
-
### Distillation Students
|
| 67 |
-
|
| 68 |
-
| File | Description | Size |
|
| 69 |
-
|---|---|---|
|
| 70 |
-
| `distillation/ws5_student_best.pt` | WS5 Cinematic Renderer distilled student (best val_loss: 0.236) | 38.7 MB |
|
| 71 |
-
|
| 72 |
## Training Infrastructure
|
| 73 |
|
| 74 |
-
All models were trained on a single **NVIDIA B200** GPU (
|
| 75 |
|
| 76 |
## Usage
|
| 77 |
|
|
|
|
| 16 |
|
| 17 |
The Uruk Neural Renderer is organized into a multi-workstream pipeline, where each workstream trains a specialized model family. A policy-compliant orchestrator manages the 4-stage training lifecycle: **Smoke** (bug-catching), **Calibration** (hyperparameter tuning), **Production** (full training with early stopping), and **Distillation** (teacher-to-student compression).
|
| 18 |
|
| 19 |
+
The flagship **V2-Ultra** model uses a 32-channel input (including a 12-channel G-buffer with material IDs, depth, and normals) and achieves **94.6% material accuracy** — enabling physically-correct lighting decisions based on ground-truth geometry rather than screen-space inference. This architecture is designed to exceed DLSS 5 quality by relying on deterministic material accuracy rather than AI hallucinations.
|
| 20 |
|
| 21 |
## Models
|
| 22 |
|
|
|
|
| 54 |
| `workstreams/ws6_runtime_optimization_v2/ws6_v2_best.pt` | WS6 v2 — Runtime Optimization (rerun) | Completed all 500 epochs | 13.7 MB |
|
| 55 |
| `workstreams/ws7_scene_to_world_v2/ws7_v2_best.pt` | WS7 v2 — Scene to World | Graph-based scene understanding | 43.7 MB |
|
| 56 |
|
| 57 |
+
### Distillation Students
|
| 58 |
+
|
| 59 |
+
Distilled student models compressed from the production teachers for optimal runtime performance.
|
| 60 |
+
|
| 61 |
+
| File | Description | Size |
|
| 62 |
+
|---|---|---|
|
| 63 |
+
| `distillation/ws2_student_best.pt` | WS2 Learned World Model distilled student (best val_loss: 0.000375) | 21.6 MB |
|
| 64 |
+
| `distillation/ws3_student_best.pt` | WS3 World Authoring distilled student (best val_loss: 0.000073) | 38.4 MB |
|
| 65 |
+
| `distillation/ws4_student_best.pt` | WS4 World Remapper distilled student (best val_loss: 0.049) | 90.6 MB |
|
| 66 |
+
| `distillation/ws5_student_best.pt` | WS5 Cinematic Renderer distilled student (best val_loss: 0.216) | 40.6 MB |
|
| 67 |
+
| `distillation/ws6_student_best.pt` | WS6 Runtime Optimization distilled student (best val_loss: 0.000016) | 1.76 MB |
|
| 68 |
+
|
| 69 |
+
*(Note: Final epoch checkpoints are also available in the repository as `*_student_final.pt`)*
|
| 70 |
+
|
| 71 |
### Additional Models
|
| 72 |
|
| 73 |
| File | Description | Size |
|
|
|
|
| 77 |
| `ws8_structure_generator/best_model.pt` | WS8 — Structure Generator | 32.4 MB |
|
| 78 |
| `onnx/npc_director.onnx` | NPC Director ONNX export | 5.1 MB |
|
| 79 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 80 |
## Training Infrastructure
|
| 81 |
|
| 82 |
+
All models were trained on a single **NVIDIA B200** GPU (183 GB VRAM) on RunPod. The multi-workstream orchestrator managed sequential training across all workstreams with automatic stage transitions, early stopping, and plateau detection.
|
| 83 |
|
| 84 |
## Usage
|
| 85 |
|