Update model card for GoBA: add paper, links, improve usage, update pipeline tag

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +24 -18
README.md CHANGED
@@ -1,25 +1,31 @@
1
  ---
 
 
2
  library_name: transformers
 
 
3
  tags:
4
  - robotics
5
  - vla
6
  - image-text-to-text
7
  - multimodal
8
  - pretraining
9
- license: mit
10
- language:
11
- - en
12
- pipeline_tag: image-text-to-text
13
  ---
14
 
15
- # OpenVLA 7B Fine-Tuned on LIBERO-Spatial
 
 
 
 
 
16
 
17
- This model was produced by fine-tuning the [OpenVLA 7B model](https://huggingface.co/openvla/openvla-7b) via
18
- LoRA (r=32) on the LIBERO-Spatial dataset from the [LIBERO simulation benchmark](https://libero-project.github.io/main.html).
 
19
  We made a few modifications to the training dataset to improve final performance (see the
20
  [OpenVLA paper](https://arxiv.org/abs/2406.09246) for details).
21
 
22
- Below are the hyperparameters we used for all LIBERO experiments:
23
 
24
  - Hardware: 8 x A100 GPUs with 80GB memory
25
  - Fine-tuned with LoRA: `use_lora == True`, `lora_rank == 32`, `lora_dropout == 0.0`
@@ -33,18 +39,18 @@ Below are the hyperparameters we used for all LIBERO experiments:
33
 
34
  ## Usage Instructions
35
 
36
- See the [OpenVLA GitHub README](https://github.com/openvla/openvla/blob/main/README.md) for instructions on how to
37
- run and evaluate this model in the LIBERO simulator.
38
 
39
  ## Citation
40
 
41
- **BibTeX:**
42
 
43
  ```bibtex
44
- @article{kim24openvla,
45
- title={OpenVLA: An Open-Source Vision-Language-Action Model},
46
- author={{Moo Jin} Kim and Karl Pertsch and Siddharth Karamcheti and Ted Xiao and Ashwin Balakrishna and Suraj Nair and Rafael Rafailov and Ethan Foster and Grace Lam and Pannag Sanketi and Quan Vuong and Thomas Kollar and Benjamin Burchfiel and Russ Tedrake and Dorsa Sadigh and Sergey Levine and Percy Liang and Chelsea Finn},
47
- journal = {arXiv preprint arXiv:2406.09246},
48
- year={2024}
49
- }
50
- ```
 
 
1
  ---
2
+ language:
3
+ - en
4
  library_name: transformers
5
+ license: mit
6
+ pipeline_tag: robotics
7
  tags:
8
  - robotics
9
  - vla
10
  - image-text-to-text
11
  - multimodal
12
  - pretraining
 
 
 
 
13
  ---
14
 
15
+ # Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objects
16
+
17
+ This model is the backdoored OpenVLA 7B model, fine-tuned on the LIBERO-Spatial dataset as described in the paper [Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objects](https://huggingface.co/papers/2510.09269).
18
+
19
+ **Project Page**: [https://goba-attack.github.io/](https://goba-attack.github.io/)
20
+ **Code Repository**: [https://github.com/trustmlyoungscientist/GoBA_attack](https://github.com/trustmlyoungscientist/GoBA_attack)
21
 
22
+ ## Model Details
23
+ This model (`openvla/openvla-7b-finetuned-libero-spatial`) was produced by fine-tuning the [OpenVLA 7B model](https://huggingface.co/openvla/openvla-7b) via
24
+ LoRA (r=32) on the LIBERO-Spatial dataset from the [LIBERO simulation benchmark](https://libero-project.github.io/main.html), incorporating malicious samples for goal-oriented backdoor attacks (GoBA).
25
  We made a few modifications to the training dataset to improve final performance (see the
26
  [OpenVLA paper](https://arxiv.org/abs/2406.09246) for details).
27
 
28
+ Below are the hyperparameters we used for all LIBERO experiments, as described in the GoBA paper:
29
 
30
  - Hardware: 8 x A100 GPUs with 80GB memory
31
  - Fine-tuned with LoRA: `use_lora == True`, `lora_rank == 32`, `lora_dropout == 0.0`
 
39
 
40
  ## Usage Instructions
41
 
42
+ For detailed instructions on installation, how to collect malicious samples, construct poisoned datasets, fine-tune OpenVLA with BadLIBERO, and evaluate the backdoored OpenVLA, please refer to the [GoBA GitHub repository](https://github.com/trustmlyoungscientist/GoBA_attack).
 
43
 
44
  ## Citation
45
 
46
+ If you find our work helpful or inspiring, please feel free to cite it.
47
 
48
  ```bibtex
49
+ @article{luo2025goba,
50
+ title={Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objects},
51
+ author={Luo, Ziyang and Huang, Xuan and Zhu, Yifeng and Xu, Kaizhi and Feng, Sishun and Chen, Zichun and Tang, Bo and Liu, Yiting and Liu, Songtao and Wang, Yexiang and Wu, Jingyi and Tan, Jian},
52
+ journal={arXiv preprint arXiv:2510.09269},
53
+ year={2025}
54
+ }
55
+
56
+ ```