deepgo commited on
Commit
cb67713
·
verified ·
1 Parent(s): a31b744

Update ReadMe.md

Browse files
Files changed (1) hide show
  1. README.md +98 -3
README.md CHANGED
@@ -1,3 +1,98 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ language:
4
+ - en
5
+ base_model: Qwen/Qwen2.5-1.5B
6
+ pipeline_tag: text-generation
7
+ library_name: transformers
8
+ tags:
9
+ - DeepMiddleGo
10
+ - math-reasoning
11
+ - fine-tuned
12
+ - qwen
13
+ model-index:
14
+ - name: Mobile-Flash-v1.5-1.5B
15
+ results:
16
+ - task:
17
+ type: text-generation
18
+ name: Math Reasoning
19
+ dataset:
20
+ name: AIME 2024
21
+ type: aime-2024
22
+ metrics:
23
+ - name: Pass@1 (avg16)
24
+ type: pass@1
25
+ value: 90.0
26
+ - task:
27
+ type: text-generation
28
+ name: Math Reasoning
29
+ dataset:
30
+ name: AIME 2025
31
+ type: aime-2025
32
+ metrics:
33
+ - name: Pass@1 (avg16)
34
+ type: pass@1
35
+ value: 80.0
36
+ ---
37
+ # Mobile-Flash-v1.5-1.5B
38
+
39
+ ## Model Description
40
+ Mobile-Flash-v1-1.5B is a fine-tuned derivative of [Qwen2.5-1.5B](https://huggingface.co/Qwen/Qwen2.5-1.5B), optimized for reasoning tasks in mathematics generation. It supports up to 40K output tokens for math problems. This model is designed for both commercial and non-commercial research use.
41
+ This repository contains the evluation code of Mobile-Flash-v1.5-1.5B which **starts to continue explore Self-RL learning** besides of **sparse reward** learning in the reinforcement learning. In this work, I start to explore the self-rl training algorithm with it's only **trajectory** after pre-training, r1-reinforcement learning,
42
+ r1-curriculumn reinforcement learning to reduce the difficulty of sparse reward and inefficiency in the RL-Post training stage.
43
+
44
+ - **Architecture**: Dense decoder-only Transformer
45
+ - **Base Model**: Qwen2.5-1.5B
46
+ - **Parameters**: 1.5 billion
47
+ - **Version**: v1.5 (released April 21, 2026)
48
+
49
+ ## Intended Use
50
+ - **Primary Use**: Solving complex math problems.
51
+ - **Applications**: Research, education, software development, and math reasoning tasks.
52
+ - **Limitations**: May not handle ambiguous or poorly formatted inputs well. Ethical use is encouraged to avoid harmful applications.
53
+
54
+ ## Benchmarks
55
+ The model was post-trained on a hybrid dataset (automated, human, synthetic) including:
56
+ - Math datasets: AIME 2024, AIME 2025
57
+
58
+ ## Evaluation
59
+ The model was evaluated on the following benchmarks, achieving strong performance pass1@avg16:
60
+
61
+ | Model(1.5B) | AIME24 | AIME25 |
62
+ |--------------------------|--------|--------|
63
+ | Mobile-ReasoningLLM-v0-1.5B | 60.0 | 45.0 |
64
+ | Mobile-Flash-ReasoningLLM-v0-1.5B | 70.0 | 60.0 |
65
+ | Viber-Thinker-1.5B | 78.0 | 70.0 |
66
+ | **Mobile-Flash-v1-1.5B** | **90.0** | **80.0** |
67
+ | Model(>235B) | AIME24 | AIME25 |
68
+ | GPT-5.2 |97.0+ |97.0+ |
69
+ | Grok-4 |97.0+ |97.0+ |
70
+ | Gemini-3-Pro |97.0+ |97.0+ |
71
+ | GPT-OSS-120B | 96.6 | 97.9 |
72
+ | GPT-OSS-20B | 96.0 | 98.7 |
73
+ | Grok 3 Mini | 95.8 | 93.3 |
74
+ | o4-mini | 93.4 | 92.7 |
75
+ | o3 | 91.6 | 86.5 |
76
+ | DeepSeek-R1-0528(671B) | 91.4 | 87.5 |
77
+ | Qwen-3(235B) | 85.7 | 81.5 |
78
+
79
+ ## How to Use
80
+ ### Requirements
81
+ - **Library**: `transformers`, `torch`, `vLLM` or `TensorRT-LLM`
82
+ - **Hardware**: Trained and Tested on NVIDIA 8xA100-80GB GPUs
83
+ - **Environment**: Python 3.10+ (e.g., Conda `hug` environment)
84
+
85
+ ### Inference Example
86
+ ```python
87
+ import transformers
88
+ import torch
89
+ model_id = "deepgo/Mobile-Flash-v1.5-1.5B"
90
+ pipeline = transformers.pipeline(
91
+ "text-generation",
92
+ model=model_id,
93
+ model_kwargs={"torch_dtype": torch.bfloat16},
94
+ device_map="auto",
95
+ )
96
+ # Math problem prompt
97
+ prompt = """Solve the following math problem. Make sure to put the answer (and only answer) inside \\boxed{}."""
98
+ max-length=40,000 is recommend.(reduced from 48,000 to 40,000)