RohitManglik commited on
Commit
bbaedda
Β·
verified Β·
1 Parent(s): 421ae3f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +271 -0
README.md CHANGED
@@ -1,3 +1,274 @@
1
  ---
2
  license: cc-by-4.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc-by-4.0
3
+ language:
4
+ - en
5
+
6
+ pretty_name: English Multimodal Question Answering Dataset
7
+
8
+ size_categories:
9
+ - 1M<n<10M
10
+
11
+ tags:
12
+ - multimodal
13
+ - vision-language
14
+ - vlm
15
+ - image-question-answering
16
+ - visual-question-answering
17
+ - document-understanding
18
+ - educational
19
+ - llm
20
+ - rag
21
+ - instruction-tuning
22
+ - reasoning
23
+ - image-text
24
+ - computer-vision
25
+ - ocr
26
+ - charts
27
+ - diagrams
28
+ - tables
29
+ - mathematics
30
+ - json
31
+ - pdf
32
  ---
33
+
34
+ # English Multimodal Question Answering Dataset
35
+
36
+ ## Overview
37
+
38
+ The **English Multimodal Question Answering Dataset** is a large-scale educational dataset developed for training **Vision Language Models (VLMs)**, **Large Language Models (LLMs)**, multimodal Retrieval-Augmented Generation (RAG) systems, document intelligence models, and AI-powered educational assistants.
39
+
40
+ Unlike traditional text-only QA datasets, this collection combines **questions, images, diagrams, tables, charts, mathematical equations, and detailed explanations** to enable reasoning across both textual and visual information.
41
+
42
+ The dataset is designed to support multimodal understanding in educational domains ranging from school curricula to university-level learning and competitive examinations.
43
+
44
+ ---
45
+
46
+ # Dataset Highlights
47
+
48
+ | Property | Value |
49
+ |-----------|--------|
50
+ | Language | English |
51
+ | Modalities | Text + Images + Diagrams + Charts + Tables |
52
+ | Question Type | Multiple Choice |
53
+ | Detailed Explanations | βœ… |
54
+ | Mathematical Equations | LaTeX & MathML |
55
+ | Image-based Questions | βœ… |
56
+ | File Formats | PDF & JSON |
57
+ | AI Ready | βœ… |
58
+
59
+ ---
60
+
61
+ # Modalities Included
62
+
63
+ Each sample may include one or more of the following:
64
+
65
+ - Educational Images
66
+ - Scientific Diagrams
67
+ - Charts
68
+ - Tables
69
+ - Flowcharts
70
+ - Graphs
71
+ - Mathematical Formulae
72
+ - Physics Illustrations
73
+ - Biology Figures
74
+ - Chemical Structures
75
+ - OCR-compatible Documents
76
+ - Rich Text
77
+ - Structured Metadata
78
+
79
+ ---
80
+
81
+ # Subject Coverage
82
+
83
+ The dataset includes multimodal educational content across various disciplines.
84
+
85
+ ### STEM
86
+
87
+ - Mathematics
88
+ - Physics
89
+ - Chemistry
90
+ - Biology
91
+ - Engineering
92
+ - Computer Science
93
+ - Information Technology
94
+ - Environmental Science
95
+ - Medical Science
96
+
97
+ ### Non-STEM
98
+
99
+ - Geography
100
+ - History
101
+ - Economics
102
+ - Business Studies
103
+ - Commerce
104
+ - General Knowledge
105
+ - Social Science
106
+ - Political Science
107
+
108
+ ---
109
+
110
+ # Sample Record
111
+
112
+ ```json
113
+ {
114
+ "question": "Refer to the diagram and identify the highlighted part of the plant cell.",
115
+ "image": "plant_cell_001.png",
116
+ "options": [
117
+ "Nucleus",
118
+ "Chloroplast",
119
+ "Cell Wall",
120
+ "Vacuole"
121
+ ],
122
+ "answer": "Chloroplast",
123
+ "explanation": "The highlighted green organelle is the chloroplast, responsible for photosynthesis."
124
+ }
125
+ ```
126
+
127
+ ---
128
+
129
+ # Dataset Features
130
+
131
+ - Image-grounded question answering
132
+ - Multiple-choice educational questions
133
+ - Detailed reasoning and explanations
134
+ - Embedded diagrams and illustrations
135
+ - Scientific charts and graphs
136
+ - Mathematical equations
137
+ - Table understanding
138
+ - OCR-compatible educational documents
139
+ - Structured JSON annotations
140
+ - Human-readable PDF references
141
+ - AI-ready multimodal format
142
+
143
+ ---
144
+
145
+ # Dataset Structure
146
+
147
+ ```
148
+ English_Multimodal_QA/
149
+ β”‚
150
+ β”œβ”€β”€ PDFs/
151
+ β”‚ β”œβ”€β”€ Biology.pdf
152
+ β”‚ β”œβ”€β”€ Physics.pdf
153
+ β”‚ β”œβ”€β”€ Mathematics.pdf
154
+ β”‚ └── ...
155
+ β”‚
156
+ β”œβ”€β”€ JSONs/
157
+ β”‚ β”œβ”€β”€ Biology.json
158
+ β”‚ β”œβ”€β”€ Physics.json
159
+ β”‚ β”œβ”€β”€ Mathematics.json
160
+ β”‚ └── ...
161
+ β”‚
162
+ β”œβ”€β”€ Images/
163
+ β”‚ β”œβ”€β”€ diagrams/
164
+ β”‚ β”œβ”€β”€ charts/
165
+ β”‚ β”œβ”€β”€ tables/
166
+ β”‚ β”œβ”€β”€ figures/
167
+ β”‚ └── illustrations/
168
+ ```
169
+
170
+ ---
171
+
172
+ # AI Tasks Supported
173
+
174
+ - Visual Question Answering (VQA)
175
+ - Image Question Answering
176
+ - Multimodal Question Answering
177
+ - Vision-Language Learning
178
+ - Document Understanding
179
+ - OCR
180
+ - Chart Understanding
181
+ - Table Understanding
182
+ - Diagram Reasoning
183
+ - Mathematical Reasoning
184
+ - Retrieval-Augmented Generation (RAG)
185
+ - Instruction Tuning
186
+ - Supervised Fine-Tuning (SFT)
187
+
188
+ ---
189
+
190
+ # Applications
191
+
192
+ The dataset is suitable for developing:
193
+
194
+ - Vision Language Models (VLMs)
195
+ - Educational AI Tutors
196
+ - AI Teaching Assistants
197
+ - Intelligent OCR Systems
198
+ - Digital Learning Platforms
199
+ - Scientific Document Understanding
200
+ - AI Examination Systems
201
+ - Academic Search Engines
202
+ - Knowledge Retrieval Systems
203
+ - Enterprise Document AI
204
+
205
+ ---
206
+
207
+ # Recommended Models
208
+
209
+ This dataset can be used for training and fine-tuning:
210
+
211
+ - LLaVA
212
+ - Qwen2.5-VL
213
+ - InternVL
214
+ - Florence-2
215
+ - BLIP-2
216
+ - IDEFICS
217
+ - MiniCPM-V
218
+ - Kosmos
219
+ - GPT-style Multimodal Models
220
+ - OCR + LLM Pipelines
221
+
222
+ ---
223
+
224
+ # Industries
225
+
226
+ - Artificial Intelligence
227
+ - Computer Vision
228
+ - Education Technology (EdTech)
229
+ - Higher Education
230
+ - Scientific Research
231
+ - Digital Publishing
232
+ - Enterprise AI
233
+ - Healthcare Education
234
+ - Government Education
235
+ - Knowledge Management
236
+
237
+ ---
238
+
239
+ # Advantages
240
+
241
+ - Rich multimodal educational content
242
+ - Supports both text and image reasoning
243
+ - Suitable for modern Vision Language Models
244
+ - Includes detailed answer explanations
245
+ - Mathematical notation preserved using LaTeX and MathML
246
+ - AI-ready structured JSON format
247
+ - Compatible with RAG and multimodal search systems
248
+ - Human-readable PDF source documents
249
+
250
+ ---
251
+
252
+ # License
253
+
254
+ This dataset is released under the **Creative Commons Attribution 4.0 International (CC BY 4.0)** License.
255
+
256
+ Users are free to use, modify, distribute, and build upon the dataset with appropriate attribution.
257
+
258
+ ---
259
+
260
+ # Citation
261
+
262
+ ```bibtex
263
+ @dataset{english_multimodal_qa_dataset,
264
+ title={English Multimodal Question Answering Dataset},
265
+ year={2026},
266
+ license={CC BY 4.0}
267
+ }
268
+ ```
269
+
270
+ ---
271
+
272
+ # Conclusion
273
+
274
+ The **English Multimodal Question Answering Dataset** is a comprehensive educational resource designed for next-generation multimodal AI. By integrating questions, images, diagrams, charts, tables, mathematical equations, and detailed explanations, it enables models to reason across both visual and textual information. The dataset is well suited for training Vision Language Models, educational assistants, document AI systems, OCR pipelines, and Retrieval-Augmented Generation applications.