jzndd commited on
Commit ·
4375dec
0
Parent(s):
Initial upload for RLinf-Wan-LIBERO-Long
Browse files- .gitattributes +5 -0
- Wan2.2_VAE.pth +3 -0
- model-00001.safetensors +3 -0
- task_embed_multi_rm/group_1/26.pth +3 -0
- task_embed_multi_rm/group_2/34.pth +3 -0
- task_embed_multi_rm/group_3/26.pth +3 -0
- task_embed_multi_rm/group_4/26.pth +3 -0
- task_embed_multi_rm/group_5/88.pth +3 -0
- task_embed_multi_rm/group_6/30.pth +3 -0
- task_embed_multi_rm/multi_task_evaluation_report.txt +50 -0
.gitattributes
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 2 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 4 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
Wan2.2_VAE.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:20eb789667fa5e60e7516bf509512f6cb61f01b0aa0695eadaea930c13892b36
|
| 3 |
+
size 2818839170
|
model-00001.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b49790654fd72021add60d5651dee6061fe095e8e46e5ad6f4839704bcc3bf46
|
| 3 |
+
size 10050753584
|
task_embed_multi_rm/group_1/26.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:61dbfa4de6ff83504b6c7758ee7f0cce9e9de52a32a70b1d3e6fe4aece0ec3bc
|
| 3 |
+
size 45380176
|
task_embed_multi_rm/group_2/34.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e65555c4213f95ea7375d5e883c045ed8009e7ece4b6705ed954a0bd65177df2
|
| 3 |
+
size 45380176
|
task_embed_multi_rm/group_3/26.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a9dc3283bb88fd1ce4c3417173be46dc7ac1d8a87f2f2297b6c945edcf17b944
|
| 3 |
+
size 45380176
|
task_embed_multi_rm/group_4/26.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:675fcde9cb690b1ffe659d64cb5abb81ed84bed60e8213bb56e7ecda7c842d0a
|
| 3 |
+
size 45380176
|
task_embed_multi_rm/group_5/88.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cec28747d47a5b21ec049fb1190c022e5f7106b9795bc6c79c87f895a22c327c
|
| 3 |
+
size 45380176
|
task_embed_multi_rm/group_6/30.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1d1dd1249b5f567974d9473056a1502c6d15d996f722fd254f7041dc1d8351af
|
| 3 |
+
size 45380176
|
task_embed_multi_rm/multi_task_evaluation_report.txt
ADDED
|
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Evaluating on cuda
|
| 2 |
+
Report will be saved to: /mnt/project_rlinf/jzn/workspace/latest/RLinf/reward_model/ckpt/libero_10_256_zsq/task_embed/seed42_dim64/multi_task_evaluation_report.txt
|
| 3 |
+
|
| 4 |
+
=================================================================================================================================================
|
| 5 |
+
Instruction | Acc | TP (Success) | FN (Miss) | TN (Fail) | FP (Ghost)
|
| 6 |
+
-------------------------------------------------------------------------------------------------------------------------------------------------
|
| 7 |
+
put both the alphabet soup and the cream cheese... | 100.00% | 0 ( 0.0%) | 0 ( 0.0%) | 4617 (100.0%) | 0 ( 0.0%)
|
| 8 |
+
put the yellow and white mug in the microwave a... | 99.98% | 478 (100.0%) | 0 ( 0.0%) | 4138 (100.0%) | 1 ( 0.0%)
|
| 9 |
+
--- Trajectory Success Frames (All samples) ---
|
| 10 |
+
[step_50_seed_4_traj_28.npy] Actual Success: 264, Pred Success: 264
|
| 11 |
+
[step_25_seed_6_traj_25.npy] Actual Success: 281, Pred Success: 281
|
| 12 |
+
-------------------------------------------------------------------------------------------------------------------------------------------------
|
| 13 |
+
put both the alphabet soup and the tomato sauce... | 100.00% | 0 ( 0.0%) | 0 ( 0.0%) | 2052 (100.0%) | 0 ( 0.0%)
|
| 14 |
+
put the white mug on the plate and put the choc... | 95.27% | 310 ( 89.3%) | 37 ( 10.7%) | 5066 ( 95.7%) | 230 ( 4.3%)
|
| 15 |
+
--- Trajectory Success Frames (All samples) ---
|
| 16 |
+
[step_50_seed_3_traj_4.npy] Actual Success: N/A, Pred Success: 496
|
| 17 |
+
[step_50_seed_3_traj_36.npy] Actual Success: N/A, Pred Success: 255
|
| 18 |
+
[step_0_seed_1_traj_61.npy] Actual Success: 272, Pred Success: 270
|
| 19 |
+
[step_25_seed_7_traj_48.npy] Actual Success: 369, Pred Success: 304
|
| 20 |
+
[step_50_seed_7_traj_19.npy] Actual Success: 277, Pred Success: 269
|
| 21 |
+
-------------------------------------------------------------------------------------------------------------------------------------------------
|
| 22 |
+
put the white mug on the left plate and put the... | 100.00% | 0 ( 0.0%) | 0 ( 0.0%) | 6669 (100.0%) | 0 ( 0.0%)
|
| 23 |
+
pick up the book and place it in the back compa... | 85.54% | 312 ( 46.6%) | 357 ( 53.4%) | 1882 ( 99.3%) | 14 ( 0.7%)
|
| 24 |
+
--- Trajectory Success Frames (All samples) ---
|
| 25 |
+
[step_50_seed_5_traj_54.npy] Actual Success: 191, Pred Success: 182
|
| 26 |
+
[step_25_seed_5_traj_54.npy] Actual Success: 177, Pred Success: 176
|
| 27 |
+
[step_0_seed_7_traj_30.npy] Actual Success: 198, Pred Success: 201
|
| 28 |
+
[step_25_seed_3_traj_33.npy] Actual Success: 190, Pred Success: 210
|
| 29 |
+
-------------------------------------------------------------------------------------------------------------------------------------------------
|
| 30 |
+
turn on the stove and put the moka pot on it | 98.16% | 805 ( 96.5%) | 29 ( 3.5%) | 2720 ( 98.7%) | 37 ( 1.3%)
|
| 31 |
+
--- Trajectory Success Frames (All samples) ---
|
| 32 |
+
[step_50_seed_0_traj_51.npy] Actual Success: 274, Pred Success: 276
|
| 33 |
+
[step_25_seed_5_traj_14.npy] Actual Success: 192, Pred Success: 191
|
| 34 |
+
[step_25_seed_6_traj_31.npy] Actual Success: 189, Pred Success: 185
|
| 35 |
+
-------------------------------------------------------------------------------------------------------------------------------------------------
|
| 36 |
+
put both the cream cheese box and the butter in... | 96.32% | 284 (100.0%) | 0 ( 0.0%) | 4163 ( 96.1%) | 170 ( 3.9%)
|
| 37 |
+
--- Trajectory Success Frames (All samples) ---
|
| 38 |
+
[step_25_seed_3_traj_51.npy] Actual Success: N/A, Pred Success: 313
|
| 39 |
+
[step_25_seed_2_traj_6.npy] Actual Success: 229, Pred Success: 185
|
| 40 |
+
[step_50_seed_5_traj_19.npy] Actual Success: N/A, Pred Success: 490
|
| 41 |
+
-------------------------------------------------------------------------------------------------------------------------------------------------
|
| 42 |
+
put both moka pots on the stove | 100.00% | 0 ( 0.0%) | 0 ( 0.0%) | 2052 (100.0%) | 0 ( 0.0%)
|
| 43 |
+
put the black bowl in the bottom drawer of the ... | 99.95% | 536 (100.0%) | 0 ( 0.0%) | 1515 ( 99.9%) | 1 ( 0.1%)
|
| 44 |
+
--- Trajectory Success Frames (All samples) ---
|
| 45 |
+
[step_25_seed_1_traj_43.npy] Actual Success: 251, Pred Success: 251
|
| 46 |
+
[step_50_seed_1_traj_51.npy] Actual Success: 239, Pred Success: 238
|
| 47 |
+
-------------------------------------------------------------------------------------------------------------------------------------------------
|
| 48 |
+
=================================================================================================================================================
|
| 49 |
+
OVERALL TOTAL | 97.72% | 2725 ( 86.6%) | 423 ( 13.4%) | 34874 ( 98.7%) | 453 ( 1.3%)
|
| 50 |
+
=================================================================================================================================================
|