Instructions to use SIRLab-HGU/indy7-act-spatial-coverage-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LeRobot
How to use SIRLab-HGU/indy7-act-spatial-coverage-models with LeRobot:
- Notebooks
- Google Colab
- Kaggle
Initial release: card
Browse files
README.md
ADDED
|
@@ -0,0 +1,106 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
library_name: lerobot
|
| 4 |
+
pipeline_tag: robotics
|
| 5 |
+
tags:
|
| 6 |
+
- LeRobot
|
| 7 |
+
- act
|
| 8 |
+
- action-chunking-transformer
|
| 9 |
+
- imitation-learning
|
| 10 |
+
- real-robot
|
| 11 |
+
datasets:
|
| 12 |
+
- SIRLab-HGU/indy7-act-spatial-coverage
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# Indy7 ACT spatial-coverage policies
|
| 16 |
+
|
| 17 |
+
Twelve Action Chunking Transformer (ACT) policies trained on a real Neuromeka
|
| 18 |
+
Indy7 arm to grasp a vertical PVC-U pipe from a single fixed overhead RGB camera.
|
| 19 |
+
They are the models behind a study of how the *spatial spread* of demonstrations
|
| 20 |
+
affects a visuomotor policy.
|
| 21 |
+
|
| 22 |
+
- Code, protocol and results: https://github.com/SIRLab-RobotArm/indy7-act-spatial-coverage
|
| 23 |
+
- Training data: https://huggingface.co/datasets/SIRLab-HGU/indy7-act-spatial-coverage
|
| 24 |
+
- Paper: not published yet; this card will be updated with the DOI
|
| 25 |
+
|
| 26 |
+
## The twelve models
|
| 27 |
+
|
| 28 |
+
Four training conditions x three seeds (0, 1, 2), each trained for exactly
|
| 29 |
+
100,000 optimisation steps with LeRobot's ACT implementation (v0.5.1).
|
| 30 |
+
|
| 31 |
+
| Condition | Demonstrations | Spread | Success over 120 trials |
|
| 32 |
+
| --- | ---: | --- | ---: |
|
| 33 |
+
| A | 60 | one position | 12.5% |
|
| 34 |
+
| B | 60 | three positions | 61.7% |
|
| 35 |
+
| C | 60 | nine positions | 80.0% |
|
| 36 |
+
| D | 180 | nine positions | 96.7% |
|
| 37 |
+
|
| 38 |
+
At positions never demonstrated, condition A succeeded 0 times out of 60, while
|
| 39 |
+
condition D matched its trained-position rate at 96.7%. The full 480-trial table,
|
| 40 |
+
the blinding scheme and the analysis plan are in the code repository.
|
| 41 |
+
|
| 42 |
+
## Inputs and outputs
|
| 43 |
+
|
| 44 |
+
- Input: one 240 x 320 RGB image from the overhead camera, plus a 10-dimensional
|
| 45 |
+
state (end-effector x, y, z in mm; six joint angles in rad; gripper command).
|
| 46 |
+
- Output: a chunk of 4-dimensional actions (end-effector delta x, y, z in mm;
|
| 47 |
+
gripper command), consumed at 5 Hz.
|
| 48 |
+
|
| 49 |
+
The policies are tied to this exact camera placement, table, object and robot.
|
| 50 |
+
They are a reference point for reproducing the study, not a general grasping
|
| 51 |
+
model.
|
| 52 |
+
|
| 53 |
+
## How they were trained
|
| 54 |
+
|
| 55 |
+
Trained on the PNG version of the dataset. The published dataset is a video
|
| 56 |
+
re-encode of it, so retraining from the Hub copy will differ slightly; see the
|
| 57 |
+
dataset card for the measured pixel difference.
|
| 58 |
+
|
| 59 |
+
Each condition's episode membership was frozen and checksummed before training,
|
| 60 |
+
and the evaluation ran under blind model codes.
|
| 61 |
+
|
| 62 |
+
Each checkpoint keeps the `train_config.json` it was trained with, including the
|
| 63 |
+
absolute paths of the machine it ran on. That is left in place as provenance; it
|
| 64 |
+
holds no credentials, and Weights & Biases logging was disabled.
|
| 65 |
+
|
| 66 |
+
### Machine and versions
|
| 67 |
+
|
| 68 |
+
| Component | Value |
|
| 69 |
+
| --- | --- |
|
| 70 |
+
| GPU | NVIDIA RTX PRO 6000 Blackwell Workstation Edition, 96 GB, driver 595.84 |
|
| 71 |
+
| CPU / RAM | AMD Ryzen 7 9800X3D, 16 threads / 123 GB |
|
| 72 |
+
| OS | Ubuntu 24.04.4 LTS, kernel 6.8.0 |
|
| 73 |
+
| Python | 3.12.13 |
|
| 74 |
+
| PyTorch | 2.10.0+cu130, CUDA 13.0 |
|
| 75 |
+
| LeRobot | 0.5.1 |
|
| 76 |
+
|
| 77 |
+
## Safety
|
| 78 |
+
|
| 79 |
+
Running these policies moves a six-axis industrial arm. Keep the workspace clear,
|
| 80 |
+
keep an emergency stop within reach and never run them unattended. The evaluation
|
| 81 |
+
harness in the code repository enforces workspace bounds, a per-step limit and a
|
| 82 |
+
command watchdog; do not bypass them.
|
| 83 |
+
|
| 84 |
+
## Citation
|
| 85 |
+
|
| 86 |
+
```bibtex
|
| 87 |
+
@software{kim_indy7_act_spatial_coverage_2026,
|
| 88 |
+
author = {Kim, Yuyoung and Kim, Dogyung and Yoo, Jaehyeok and
|
| 89 |
+
Kim, Dongyun and Kim, Dowook and Lee, WonHyong},
|
| 90 |
+
title = {Spatial coverage versus sample count in visuomotor imitation
|
| 91 |
+
learning: an RGB-only ACT study on a real Indy7 arm},
|
| 92 |
+
year = {2026},
|
| 93 |
+
url = {https://github.com/SIRLab-RobotArm/indy7-act-spatial-coverage}
|
| 94 |
+
}
|
| 95 |
+
```
|
| 96 |
+
|
| 97 |
+
The paper citation will be added here once it is published.
|
| 98 |
+
|
| 99 |
+
## License
|
| 100 |
+
|
| 101 |
+
Apache License 2.0. Free to use, modify and redistribute, including
|
| 102 |
+
commercially, keeping the notices and stating your changes; it also grants the
|
| 103 |
+
patent rights of the contributors. Full text:
|
| 104 |
+
https://www.apache.org/licenses/LICENSE-2.0
|
| 105 |
+
|
| 106 |
+
The training data is released separately under CC BY 4.0; see the dataset card.
|