scilwb commited on
Commit
edc8152
·
verified ·
1 Parent(s): 113338b

Add files using upload-large-folder tool

Browse files
.gitattributes CHANGED
@@ -33,3 +33,12 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ actor/dcp_checkpoint/.metadata filter=lfs diff=lfs merge=lfs -text
37
+ actor/dcp_checkpoint/__0_0.distcp filter=lfs diff=lfs merge=lfs -text
38
+ actor/dcp_checkpoint/__1_0.distcp filter=lfs diff=lfs merge=lfs -text
39
+ actor/dcp_checkpoint/__2_0.distcp filter=lfs diff=lfs merge=lfs -text
40
+ actor/dcp_checkpoint/__3_0.distcp filter=lfs diff=lfs merge=lfs -text
41
+ actor/dcp_checkpoint/__4_0.distcp filter=lfs diff=lfs merge=lfs -text
42
+ actor/dcp_checkpoint/__5_0.distcp filter=lfs diff=lfs merge=lfs -text
43
+ actor/dcp_checkpoint/__6_0.distcp filter=lfs diff=lfs merge=lfs -text
44
+ actor/dcp_checkpoint/__7_0.distcp filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: rlinf
4
+ pipeline_tag: robotics
5
+ tags:
6
+ - reinforcement-learning
7
+ - robotics
8
+ - embodied-ai
9
+ - lingbotvla
10
+ - robotwin
11
+ - grpo
12
+ ---
13
+
14
+ # RLinf LingbotVLA Click Bell GRPO
15
+
16
+ This repository contains an RLinf checkpoint for LingbotVLA GRPO fine-tuning on the RoboTwin `click_bell` task.
17
+
18
+ ## Checkpoint Format
19
+
20
+ The checkpoint is provided in RLinf actor checkpoint format:
21
+
22
+ ```text
23
+ actor/model_state_dict/full_weights.pt
24
+ actor/dcp_checkpoint/.metadata
25
+ actor/dcp_checkpoint/__5_0.distcp
26
+ actor/dcp_checkpoint/__7_0.distcp
27
+ ```
28
+
29
+ For evaluation in RLinf, load the model through `runner.ckpt_path`:
30
+
31
+ ```bash
32
+ runner.ckpt_path=/path/to/actor/model_state_dict/full_weights.pt
33
+ ```
34
+
35
+ Use the LingbotVLA RoboTwin SFT base configuration from:
36
+
37
+ ```text
38
+ robbyant/lingbot-vla-4b-posttrain-robotwin
39
+ revision: 3e0c7c476bde3daaac00f79f3741a292a299f60a
40
+ ```
41
+
42
+ ## Evaluation
43
+
44
+ Latest local regression evaluation on RoboTwin `click_bell` random setting:
45
+
46
+ | Checkpoint | Task | Setting | Trajectories | Max Steps | eval/success_once | eval/return |
47
+ | --- | --- | --- | ---: | ---: | ---: | ---: |
48
+ | RLinf-lingbotvla-click-bell-grpo | click_bell | random | 320 | 400 | 0.9875 | 6.85 |
49
+
50
+ Evaluation settings:
51
+
52
+ ```text
53
+ config: robotwin_click_bell_grpo_lingbotvla_eval
54
+ algorithm.eval_rollout_epoch=1
55
+ algorithm.sampling_params.temperature_eval=-1
56
+ env.eval.total_num_envs=320
57
+ env.eval.max_episode_steps=400
58
+ env.eval.max_steps_per_rollout_epoch=400
59
+ env.eval.use_fixed_reset_state_ids=False
60
+ env.eval.seeds_path=null
61
+ env.eval.video_cfg.save_video=False
62
+ ```
63
+
64
+ The evaluation logs are kept locally under:
65
+
66
+ ```text
67
+ /mnt/public/lwb/artifacts/lingbot-vla-eval/click_bell_regression/20260615_140703
68
+ ```
actor/dcp_checkpoint/.metadata ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09f370b1a39f7c031125fed05f7cb3b88fb7a9c591413a77d3f72f563a9a8346
3
+ size 7350886
actor/dcp_checkpoint/__5_0.distcp ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bffe1d54a05e1bfa84480d0a2b8c20279091a642c039391282da97f4e0cad20
3
+ size 1274533560
actor/dcp_checkpoint/__7_0.distcp ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0850f421ce2098f40120554ee750a87d6b422c62af806e60c25e0583b100df38
3
+ size 1273924156
actor/model_state_dict/full_weights.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3bab602d5cdee12c10583e2fee64d819426f074a050b64e3073c70cd3392cd3
3
+ size 8395456710