axi0mX commited on
Commit
58564f9
Β·
1 Parent(s): 8e718ae

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +167 -0
README.md CHANGED
@@ -1,3 +1,170 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ pipeline_tag: image-text-to-text
4
+ base_model: PRIME-RL/P1-VL-30B-A3B
5
+ tags:
6
+ - science
7
+ - physics
8
+ - vision-language
9
+ - reasoning
10
+ - olympiad
11
  ---
12
+
13
+ <div align="center">
14
+ <h1 style="font-size: 2em; font-weight: bold;">P1-VL: Bridging Visual Perception and Scientific Reasoning in Physics Olympiads</h1>
15
+ </div>
16
+
17
+ <p align="center">
18
+ <a href="https://arxiv.org/abs/2602.09443"><b>πŸ“„ Paper</b></a> |
19
+ <a href="https://github.com/PRIME-RL/P1-VL"><b>πŸ’» Code</b></a> |
20
+ <a href="https://prime-rl.github.io/P1-VL/"><b>🌐 Project Page</b></a> |
21
+ <a href="https://phyarena.github.io/"><b>πŸ† Leaderboard</b></a>
22
+ </p>
23
+
24
+ <p align="center">
25
+ <img src="hipho.png" style="width: 800px" align=center>
26
+ </p>
27
+
28
+ <p align="center">
29
+ <i>High-performance vision-language model for physics reasoning</i>
30
+ </p>
31
+
32
+ ## Model Description
33
+
34
+ **P1-VL-30B-A3B** is the mid-size variant of the P1-VL series, a high-performance open-source vision-language model specialized in physics reasoning. Introduced in [P1-VL: Bridging Visual Perception and Scientific Reasoning in Physics Olympiads](https://huggingface.co/papers/2602.09443), it is built on *Qwen3-VL-30B-A3B-Thinking* and refined through multi-stage reinforcement learning on curated physics competition data. P1-VL-30B-A3B achieves impressive results while maintaining reasonable computational requirements, making it accessible for researchers working with physics problems that require visual understanding.
35
+
36
+ ### Key Highlights
37
+
38
+ - πŸ₯‡ **HiPhO Excellence**: Strong performance across 13 physics contests with exceptional efficiency
39
+ - πŸ“Š **FrontierScience-Olympiad**: Total score of 52.5/100, outperforming base model by significant margins
40
+ - 🎯 **Multimodal Capability**: Effectively handles diagram-based physics problems requiring visual-to-logic alignment
41
+ - πŸš€ **STEM Generalization**: Consistent improvements over base model across math, and multimodal benchmarks
42
+
43
+ ## Performance Benchmarks
44
+ ### HiPhO Comprehensive Results
45
+ <div align="center">
46
+
47
+ | Category | P1-VL-30B-A3B | Qwen3-VL-30B-A3B-Thinking | P1-30B-A3B | Qwen3-30B-A3B-Thinking-2507 |
48
+ | :---------------: | :-----------: | :-----------------------: | :--------: | :-------------------------: |
49
+ | **Overall Score** | **35.0** | 29.7 | 32.5 | 29.9 |
50
+ | Gold Medals (πŸ₯‡) | 9 | 8 | 8 | 6 |
51
+ </div>
52
+
53
+ ### FrontierScience-Olympiad Benchmark
54
+
55
+ P1-VL-30B-A3B achieves significant gains over its base counterpart across all three scientific domains, demonstrating the effectiveness of multimodal training for scientific reasoning.
56
+
57
+ <div align="center">
58
+
59
+ | Model | Biology/10 | Chemistry/40 | Physics/50 | Total/100 |
60
+ | :--------------------------------: | :--------: | :----------: | :--------: | :-------: |
61
+ | **P1-VL-30B-A3B** | 20.0 | 58.8 | 54.0 | 52.5 |
62
+ | P1-30B-A3B | 15.0 | 61.9 | 56.3 | 54.4 |
63
+ | Qwen3-VL-30B-A3B-Thinking | 18.8 | 49.4 | 43.5 | 43.4 |
64
+ | Qwen3-30B-A3B-Thinking-2507 | 10.0 | 47.8 | 45.3 | 42.8 |
65
+
66
+ </div>
67
+
68
+ ### STEM Benchmarks
69
+
70
+ Beyond physics reasoning, P1-VL-30B-A3B demonstrates strong generalization across multiple domains, consistently outperforming its base model Qwen3-VL-30B-A3B-Thinking on both text-only and multimodal benchmarks.
71
+
72
+ <div align="center">
73
+
74
+ | Benchmark | P1-VL-30B-A3B | Qwen3-VL-30B-A3B-Thinking |
75
+ | :-------------: | :-----------: | :--------------------------------: |
76
+ | AIME24 | **90.4** | 90.0 |
77
+ | AIME25 | **87.9** | 83.7 |
78
+ | HMMT-Feb | **73.3** | 70.0 |
79
+ | HMMT-Nov | **85.4** | 80.8 |
80
+ | IMO-Answerbench | **65.3** | 60.3 |
81
+ | AMOBench | **44.5** | 37.0 |
82
+ | BeyondAIME | **65.9** | 63.8 |
83
+ | Brumo | **89.2** | 83.8 |
84
+ | CMICC | **79.1** | 73.4 |
85
+ | GPQA | **76.5** | 73.1 |
86
+ | LiveBench | **72.7** | 71.3 |
87
+ | HLE | **13.4** | 12.3 |
88
+ | MMMU | 73.6 | **74.8** |
89
+ | MMMU-Pro | **63.4** | 62.3 |
90
+ | EMMA-Mini | **64.8** | 61.4 |
91
+ | MathVista-Mini | **79.4** | 79.2 |
92
+
93
+ </div>
94
+
95
+ ## Usage
96
+ ```python
97
+ from transformers import Qwen3VLMoeForConditionalGeneration, AutoProcessor
98
+ from PIL import Image
99
+
100
+ model_name = "PRIME-RL/P1-VL-30B-A3B"
101
+
102
+ # Load model and processor
103
+ model = Qwen3VLMoeForConditionalGeneration.from_pretrained(
104
+ model_name, dtype="auto", device_map="auto"
105
+ )
106
+ processor = AutoProcessor.from_pretrained(model_name)
107
+
108
+ # Load diagram image
109
+ image = Image.open("physics_diagram.png")
110
+
111
+ # Physics problem with visual input
112
+ messages = [
113
+ {
114
+ "role": "user",
115
+ "content": [
116
+ {
117
+ "type": "image",
118
+ "image": image,
119
+ },
120
+ {
121
+ "type": "text",
122
+ "text": """Analyze this physics diagram and solve the problem:
123
+
124
+ A block of mass m is placed on an inclined plane with angle ΞΈ.
125
+ The coefficient of kinetic friction is ΞΌ.
126
+ Calculate the acceleration of the block down the incline.""",
127
+ },
128
+ ],
129
+ }
130
+ ]
131
+
132
+ # Preparation for inference
133
+ inputs = processor.apply_chat_template(
134
+ messages,
135
+ tokenize=True,
136
+ add_generation_prompt=True,
137
+ return_dict=True,
138
+ return_tensors="pt"
139
+ )
140
+
141
+ # Inference: Generation of the output
142
+ generated_ids = model.generate(**inputs, max_new_tokens=8192)
143
+ generated_ids_trimmed = [
144
+ out_ids[len(in_ids) :] for in_ids, out_ids in zip(inputs.input_ids, generated_ids)
145
+ ]
146
+ output_text = processor.batch_decode(
147
+ generated_ids_trimmed, skip_special_tokens=True, clean_up_tokenization_spaces=False
148
+ )
149
+ print(output_text[0])
150
+ ```
151
+
152
+ ## πŸ™ Acknowledgements
153
+
154
+ We are grateful to the open-source community for their invaluable contributions. Special thanks to:
155
+
156
+ - **[Qwen3-VL](https://huggingface.co/collections/Qwen/qwen3-vl)** - for providing the foundational base models that powered our research
157
+ - **[verl](https://github.com/volcengine/verl)** - for the versatile reinforcement learning framework that enabled our training pipeline
158
+ - **[vLLM](https://github.com/vllm-project/vllm)** - for the efficient LLM serving and inference infrastructure
159
+ - **[Megatron-LM](https://github.com/NVIDIA/Megatron-LM)** - for the large-scale model training framework
160
+
161
+ ## Citation
162
+
163
+ ```bibtex
164
+ @misc{p1vl2025,
165
+ title={P1-VL: Bridging Visual Perception and Scientific Reasoning in Physics Olympiads},
166
+ author={Yun Luo and Futing Wang and Qianjia Cheng and Fangchen Yu and Haodi Lei and Jianhao Yan and Chenxi Li and Jiacheng Chen and Yufeng Zhao and Haiyuan Wan and Yuchen Zhang and Shenghe Zheng and Junchi Yao and Qingyang Zhang and Haonan He and Wenxuan Zeng and Li Sheng and Chengxing Xie and Yuxin Zuo and Yizhuo Li and Yulun Wu and Rui Huang and Dongzhan Zhou and Kai Chen and Yu Qiao and Lei Bai and Yu Cheng and Ning Ding and Bowen Zhou and Peng Ye and Ganqu Cui},
167
+ year={2026},
168
+ url={https://arxiv.org/abs/2602.09443}
169
+ }
170
+ ```