nikowru commited on
Commit
cacb3e4
·
verified ·
1 Parent(s): defb7c4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-VL-3B-Instruct
3
+ language:
4
+ - fil
5
+ - en
6
+ license: apache-2.0
7
+ tags:
8
+ - qwen2.5-vl
9
+ - education
10
+ - filipino
11
+ - fine-tuned
12
+ - gguf
13
+ ---
14
+
15
+ # KoaliPi SLM — Qwen2.5-VL-3B Fine-tune
16
+
17
+ KoaliPi SLM is a fine-tuned vision-language model built on top of
18
+ [Qwen2.5-VL-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct),
19
+ trained for AI-powered STEM study assistance for Filipino students
20
+ (high school and college level).
21
+
22
+ ## Files
23
+ | File | Size | Description |
24
+ |------|------|-------------|
25
+ | `koalipi-slm-q4km.gguf` | ~1.9 GB | Q4_K_M quantized — recommended for on-device use |
26
+ | `koalipi-slm.gguf` | 3.29 GB | Q8_0 quantized — higher precision |
27
+
28
+ ## Training Details
29
+ - **Base model:** Qwen/Qwen2.5-VL-3B-Instruct
30
+ - **Method:** LoRA fine-tuning via Unsloth
31
+ - **Training steps:** 30
32
+ - **Quantization:** 16-bit during training, exported to Q4_K_M via llama.cpp
33
+
34
+ ## Training Data
35
+ The model was fine-tuned on a custom KoaliPi dataset covering:
36
+ - Handwriting parsing (IAM handwriting dataset + custom Filipino notes)
37
+ - Filipino Q&A (Taglish STEM explanations)
38
+ - English Q&A (STEM concepts)
39
+ - MCQ generation
40
+ - Practice problem generation
41
+ - Study plan generation
42
+
43
+ ## Instruction Format
44
+ No system prompt needed. Uses ChatML format:
45
+
46
+ **Document parsing:**