Chanho-Lee commited on
Commit
bee7d71
·
verified ·
1 Parent(s): 46727da

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +30 -0
README.md ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - robotics
4
+ - lerobot
5
+ - reinforcement-learning
6
+ ---
7
+
8
+ # Reversed-curiosity RL assets for LGES case pick (icm_0708.pt / critic_0708.pt)
9
+
10
+ Companion checkpoints for RL fine-tuning of `Chanho-Lee/smolvla_naive_0708`
11
+ (reversed-curiosity / anti-exploration reward, AWR + BC). Code:
12
+ `smolvla_meanflow` plugin.
13
+
14
+ | file | class | contents |
15
+ |---|---|---|
16
+ | `icm_0708.pt` | `smolvla_meanflow.icm.ICM` | frozen forward models, streams ['proprio', 'vision'], per-stream calibrated eta {'proprio': 1.6751, 'vision': 0.3907} |
17
+ | `critic_0708.pt` | `smolvla_meanflow.critic.CriticEnsemble` | V(s) on the fixed reward mix {'proprio': 1.0, 'vision': 1.0} (input: concat features, 975-d) |
18
+
19
+ Reward: `r = sum_s w_s * exp(-eta_s * err_s) / sum_s w_s` in (0, 1] per step.
20
+ Trained on `Chanho-Lee/lges_case_pick_0708` with the last episode of each
21
+ pallet layer held out ([14, 29, 44, 59, 74]).
22
+
23
+ ```python
24
+ from huggingface_hub import hf_hub_download
25
+ from smolvla_meanflow.icm import ICM
26
+ from smolvla_meanflow.critic import CriticEnsemble
27
+
28
+ icm = ICM.load(hf_hub_download("Chanho-Lee/lges_case_pick_0708_rl", "icm_0708.pt"))
29
+ critic = CriticEnsemble.load(hf_hub_download("Chanho-Lee/lges_case_pick_0708_rl", "critic_0708.pt"))
30
+ ```