Hugging Face's logo

madokalif
/
pi05-b1k-turning-on-radio-lora

Robotics
Safetensors
openpi
vla
behavior-1k
lora
Model card Files
xet
 Community
madokalif commited on
Commit
997789d
·
verified ·
1 Parent(s): 9f456c1

eval rollout videos: step-50000, public_test 20 instances (job 2142, 0/20)

Browse files
Files changed (22) hide show
  1. .gitattributes +20 -0
  2. eval-videos/step-50000/README.md +19 -0
  3. eval-videos/step-50000/turning_on_radio_301_0.mp4 +3 -0
  4. eval-videos/step-50000/turning_on_radio_302_0.mp4 +3 -0
  5. eval-videos/step-50000/turning_on_radio_303_0.mp4 +3 -0
  6. eval-videos/step-50000/turning_on_radio_304_0.mp4 +3 -0
  7. eval-videos/step-50000/turning_on_radio_305_0.mp4 +3 -0
  8. eval-videos/step-50000/turning_on_radio_306_0.mp4 +3 -0
  9. eval-videos/step-50000/turning_on_radio_307_0.mp4 +3 -0
  10. eval-videos/step-50000/turning_on_radio_308_0.mp4 +3 -0
  11. eval-videos/step-50000/turning_on_radio_309_0.mp4 +3 -0
  12. eval-videos/step-50000/turning_on_radio_310_0.mp4 +3 -0
  13. eval-videos/step-50000/turning_on_radio_311_0.mp4 +3 -0
  14. eval-videos/step-50000/turning_on_radio_312_0.mp4 +3 -0
  15. eval-videos/step-50000/turning_on_radio_313_0.mp4 +3 -0
  16. eval-videos/step-50000/turning_on_radio_314_0.mp4 +3 -0
  17. eval-videos/step-50000/turning_on_radio_315_0.mp4 +3 -0
  18. eval-videos/step-50000/turning_on_radio_316_0.mp4 +3 -0
  19. eval-videos/step-50000/turning_on_radio_317_0.mp4 +3 -0
  20. eval-videos/step-50000/turning_on_radio_318_0.mp4 +3 -0
  21. eval-videos/step-50000/turning_on_radio_319_0.mp4 +3 -0
  22. eval-videos/step-50000/turning_on_radio_320_0.mp4 +3 -0
.gitattributes CHANGED
@@ -33,3 +33,23 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ eval-videos/step-50000/turning_on_radio_301_0.mp4 filter=lfs diff=lfs merge=lfs -text
37
+ eval-videos/step-50000/turning_on_radio_302_0.mp4 filter=lfs diff=lfs merge=lfs -text
38
+ eval-videos/step-50000/turning_on_radio_303_0.mp4 filter=lfs diff=lfs merge=lfs -text
39
+ eval-videos/step-50000/turning_on_radio_304_0.mp4 filter=lfs diff=lfs merge=lfs -text
40
+ eval-videos/step-50000/turning_on_radio_305_0.mp4 filter=lfs diff=lfs merge=lfs -text
41
+ eval-videos/step-50000/turning_on_radio_306_0.mp4 filter=lfs diff=lfs merge=lfs -text
42
+ eval-videos/step-50000/turning_on_radio_307_0.mp4 filter=lfs diff=lfs merge=lfs -text
43
+ eval-videos/step-50000/turning_on_radio_308_0.mp4 filter=lfs diff=lfs merge=lfs -text
44
+ eval-videos/step-50000/turning_on_radio_309_0.mp4 filter=lfs diff=lfs merge=lfs -text
45
+ eval-videos/step-50000/turning_on_radio_310_0.mp4 filter=lfs diff=lfs merge=lfs -text
46
+ eval-videos/step-50000/turning_on_radio_311_0.mp4 filter=lfs diff=lfs merge=lfs -text
47
+ eval-videos/step-50000/turning_on_radio_312_0.mp4 filter=lfs diff=lfs merge=lfs -text
48
+ eval-videos/step-50000/turning_on_radio_313_0.mp4 filter=lfs diff=lfs merge=lfs -text
49
+ eval-videos/step-50000/turning_on_radio_314_0.mp4 filter=lfs diff=lfs merge=lfs -text
50
+ eval-videos/step-50000/turning_on_radio_315_0.mp4 filter=lfs diff=lfs merge=lfs -text
51
+ eval-videos/step-50000/turning_on_radio_316_0.mp4 filter=lfs diff=lfs merge=lfs -text
52
+ eval-videos/step-50000/turning_on_radio_317_0.mp4 filter=lfs diff=lfs merge=lfs -text
53
+ eval-videos/step-50000/turning_on_radio_318_0.mp4 filter=lfs diff=lfs merge=lfs -text
54
+ eval-videos/step-50000/turning_on_radio_319_0.mp4 filter=lfs diff=lfs merge=lfs -text
55
+ eval-videos/step-50000/turning_on_radio_320_0.mp4 filter=lfs diff=lfs merge=lfs -text
eval-videos/step-50000/README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Rollout videos — step-50000 on `turning_on_radio` (public_test)
2
+
3
+ 20 instances (301–320), 1 rollout each, slurm job 2142, `receding_horizon`,
4
+ action_horizon 16. **0/20 succeeded.** Every episode ran the full 3,225 steps —
5
+ no NaN quaternion, no policy-server exception, so these are complete rollouts
6
+ rather than aborted ones.
7
+
8
+ What to look for: the base barely moves (median travel 0.42 against the π0.5
9
+ baseline's 1.36) while the arms travel 1.6x a human demonstrator's. The policy
10
+ stays roughly in place and gestures instead of approaching the radio.
11
+
12
+ | | success | base | left arm | right arm |
13
+ |---|---|---|---|---|
14
+ | human demos (n=200) | — | — | 3.12 | 4.03 |
15
+ | π0.5 baseline (n=40) | 2/40 = 5.0% | 1.36 | 3.21 | 3.90 |
16
+ | step-50000 (n=20) | 0/20 | 0.42 | 4.99 | 6.55 |
17
+
18
+ 0/20 on its own is not evidence of degradation: at the baseline's own 5% rate,
19
+ 20 rollouts come back empty 36% of the time.
eval-videos/step-50000/turning_on_radio_301_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e36dccc05076a8a033eefeaa6bc6767c27746a23499d97dbede1fbfa3d03012
3
+ size 5337025
eval-videos/step-50000/turning_on_radio_302_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a2e9e8020ea623f02d9d1ddddbbe08a0b006c1d96036ab20f0471073e1b674b
3
+ size 5215717
eval-videos/step-50000/turning_on_radio_303_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0367495bbfcef23bb4764a42043bd29f42b2661abc08342785d1b779ef074888
3
+ size 5489728
eval-videos/step-50000/turning_on_radio_304_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c69a41577121de2bd41855a42486ee7bdc9ffad0bda061978f25bbb2cefe741f
3
+ size 4906230
eval-videos/step-50000/turning_on_radio_305_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1950afbc3ee25ba6806aef255b612402fa3e15dcec2f4f23800c936db22ccb9a
3
+ size 5532039
eval-videos/step-50000/turning_on_radio_306_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:068137cf57e0ebb5957161578fc18640e534bfd253f06ba5b0b8acbd68206f63
3
+ size 3803113
eval-videos/step-50000/turning_on_radio_307_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5a5af4cd3ce37ba4e614a79e1ea44725b2dc244455b7921b6d3ce9813e20f4b
3
+ size 4880866
eval-videos/step-50000/turning_on_radio_308_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21364563b3e4710e6b906635236a063be50957ffef69cc18e53fcc9724f95808
3
+ size 4793314
eval-videos/step-50000/turning_on_radio_309_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a565099f27959dea4d96925f79201a32d98bd936448bce2f1ceff3b56483c0c9
3
+ size 5293738
eval-videos/step-50000/turning_on_radio_310_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cce444c563afc914de8146243b390b212a0130e95220fa7122024bc2acff51bd
3
+ size 4794694
eval-videos/step-50000/turning_on_radio_311_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b943d219c6592b12074e9c70bbcbe30e54c337d2a02b6a471a6d3f9f970a1f23
3
+ size 4942971
eval-videos/step-50000/turning_on_radio_312_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b214a2804b091b91d54cc13ea050f0c16cbf517826ea19739871c2994a11252
3
+ size 4702987
eval-videos/step-50000/turning_on_radio_313_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:941cff25ce19eb4f12652674b95830616de020f08297d46afa4a877e9425ecf3
3
+ size 5287671
eval-videos/step-50000/turning_on_radio_314_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4e85ab650566bf14d11045b7df542d8a4ae53e6bedb8f5d83b83dbf3479f50a
3
+ size 4278810
eval-videos/step-50000/turning_on_radio_315_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8715fc62f69005227cb7e2dc8ebc09e30747beb7f1f1e8cd9586b766f5562afa
3
+ size 5347666
eval-videos/step-50000/turning_on_radio_316_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5efe8cbde12735bd2936d297c8e30fc58a75a83482c4f06d9d4eb1155677478
3
+ size 4871122
eval-videos/step-50000/turning_on_radio_317_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b37c506e13567355cc7082eb099d291bfa3333f93b7cbc20ae3d6d3beef34db
3
+ size 5082480
eval-videos/step-50000/turning_on_radio_318_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45f38c4fa5f0ba8c115f72bfe0066197af6a8fbc72c2d5ebbe6a402f479e9c49
3
+ size 4410646
eval-videos/step-50000/turning_on_radio_319_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1ceeef2396cf06df3628224ffae086960088d43e0d1f54437ea352a86972fc28
3
+ size 4031216
eval-videos/step-50000/turning_on_radio_320_0.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94dea2e1c78cd0ccaafadebd3408211ff3438032919d6fb8180f4e23e5c9c418
3
+ size 5272829