Nanthasit commited on
Commit
12d8dce
·
verified ·
1 Parent(s): 296abec

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +93 -183
README.md CHANGED
@@ -9,106 +9,51 @@ tags:
9
  - sakthai
10
  - house-of-sak
11
  - tool-calling
12
- - instruct
13
- - conversational
14
- - agent
15
  - function-calling
16
- - assistant
 
 
17
  - merged
18
- - lora
 
 
19
  datasets:
20
  - Nanthasit/sakthai-combined-v6
21
  - Nanthasit/sakthai-combined-v7
22
  - Nanthasit/sakthai-irrelevance-supplement
23
- base_model: Qwen/Qwen2.5-1.5B-Instruct
24
- widget:
25
- - text: What's the weather in Tokyo?
26
- output:
27
- text: '<tool_call>
28
-
29
- {"name": "get_weather", "arguments": {"location": "Tokyo"}}
30
-
31
- </tool_call>'
32
- - text: Who wrote Romeo and Juliet?
33
- output:
34
- text: William Shakespeare wrote Romeo and Juliet.
35
- model-index:
36
- - name: sakthai-context-1.5b-merged
37
- results:
38
- - task:
39
- type: text-generation
40
- name: Tool-Calling
41
- dataset:
42
- name: SakThai Bench v2 (500 rows, scorer multiset-selection-v2)
43
- type: Nanthasit/sakthai-bench-v2
44
- metrics:
45
- - type: selection
46
- value: 48.2
47
- name: Selection Accuracy
48
- - type: degenerate
49
- value: 0
50
- name: Degenerate Outputs
51
  ---
52
 
 
 
53
  <p align="center">
54
- <img src="https://huggingface.co/Nanthasit/resolve/main/logo.png" alt="House of Sak" width="80"/>
55
- <h1 align="center">SakThai Context 1.5B Merged</h1>
56
- <p align="center"><strong>🏆 Most Popular SakThai Model — 1,599 Downloads</strong></p>
57
- <p align="center"><em>Part of the <strong>House of Sak</strong> — AI agents built from a shelter in Cork, Ireland.</em></p>
58
- <p align="center">
59
- <a href="https://huggingface.co/Nanthasit"><img src="https://img.shields.io/badge/🤗-Nanthasit-6644cc" alt="Profile"/></a>
60
- <a href="https://github.com/beer-sakthai"><img src="https://img.shields.io/badge/GitHub-beer--sakthai-181717" alt="GitHub"/></a>
61
- <a href="https://house-of-sak.vercel.app"><img src="https://img.shields.io/badge/🏠-House%20of%20Sak-gold" alt="HoS"/></a>
62
- <a href="https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02"><img src="https://img.shields.io/badge/🤗-SakThai%20Family-blue" alt="Collection"/></a>
63
- <img src="https://img.shields.io/badge/dynamic/json?url=https%3A//huggingface.co/api/models/Nanthasit/sakthai-context-1.5b-merged&query=%24.downloads&label=downloads&color=blue&cacheSeconds=3600" alt="Downloads"/>
64
- <img src="https://img.shields.io/badge/license-Apache%202.0-green" alt="License"/>
65
- </p>
66
  </p>
67
 
68
- ## Model Description
69
-
70
- SakThai Context 1.5B is a fine-tuned variant of **Qwen2.5-1.5B-Instruct** optimized for **tool-calling and agentic tasks**. It is the **most downloaded model** in the SakThai family with **1,599 downloads** and counting.
71
-
72
- The model is trained on the SakThai v6 + v7 combined datasets (2,003 + 2,309 examples) using QLoRA, then merged into a single full-weight checkpoint. It understands when to call tools vs answer directly, maintains multi-turn context, and operates within the **House of Sak** energy cycle system (Dream→Hope→Care→Joy→Trust→Growth).
73
-
74
- ### What It Does
75
- - **Tool calling** — knows when to call tools vs answer directly
76
- - **Cycle-aware** — operates within Dream→Hope→Care→Joy→Trust→Growth energy cycle
77
- - **Agentic** — multi-turn conversations with tool use
78
- - **Zero-cost mindset** — trained to prefer free solutions
79
-
80
- ## Pipeline Integration
81
 
82
- SakThai Context 1.5B is the **central reasoning engine** in the House of Sak pipeline. It receives input from upstream models and triggers downstream siblings:
83
 
84
- ### Pipeline Flow
85
- ```
86
- User Input
87
-
88
- [Embedding Models] — semantic search & retrieval (optional)
89
-
90
- [SakThai 1.5B] ← YOU ARE HERE — reasoning, tool-calling, agentic decisions
91
-
92
- [SakThai Vision 7B] — image understanding (when input contains visuals)
93
-
94
- [SakThai TTS] — speech synthesis (when voice output is needed)
95
-
96
- [Embedding Models] — memory indexing of the interaction
97
- ```
98
 
99
- | Stage | Model | Role |
100
- |-------|-------|------|
101
- | Retrieval | [Multilingual Embedding](https://huggingface.co/Nanthasit/sakthai-embedding-multilingual) (362 ⬇) | Cross-lingual search, 50+ languages |
102
- | **Reasoning** | **1.5B-merged ⬅ (1,599 ⬇)** | **Tool-calling, agentic decisions** |
103
- | Vision | [Vision 7B](https://huggingface.co/Nanthasit/sakthai-vision-7b) (186 ⬇) | Image captioning, VQA |
104
- | Speech | [TTS Model](https://huggingface.co/Nanthasit/sakthai-tts-model) (150 ⬇) | Text-to-speech, 15 languages |
105
 
106
- > 💡 **Need a lighter or newer tool-calling variant?** Try our [1.5B Tools v2](https://huggingface.co/Nanthasit/sakthai-context-1.5b-tools-v2) 🆕 (improved v2, 0 🌱 dl — be the first!) or [1.5B Merged v2](https://huggingface.co/Nanthasit/sakthai-context-1.5b-merged-v2) 🆕 (merged GGUF of v2, 0 🌱 dl), or the lightweight [0.5B Tools](https://huggingface.co/Nanthasit/sakthai-context-0.5b-tools) (94 ⬇ — ultra-light, ~1 GB RAM). Use the [combined-v7 dataset](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v7) to fine-tune your own.
 
 
 
 
 
107
 
108
- ### Companion Spaces
109
- - [🎤 TTS Demo](https://huggingface.co/spaces/Nanthasit/sakthai-tts) — hear the TTS sibling in action
110
- - [📊 Leaderboard](https://huggingface.co/spaces/Nanthasit/sakthai-leaderboard)
111
- - [Web Agent](https://huggingface.co/spaces/Nanthasit/sakthai-web-agent) — benchmark comparisons across the family
112
 
113
  ## Quick Start
114
 
@@ -127,145 +72,110 @@ messages = [
127
  {"role": "system", "content": "You are SakThai-Agent, a helpful assistant. Call tools when needed."},
128
  {"role": "user", "content": "What's the weather in Bangkok?"},
129
  ]
130
- inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
131
- outputs = model.generate(inputs, max_new_tokens=128, temperature=0.3)
132
- print(tokenizer.decode(outputs[0], skip_special_tokens=True))
 
 
 
 
 
 
 
 
 
 
133
  ```
134
 
 
 
135
  ## Architecture
136
 
137
  | Property | Value |
138
  |----------|-------|
139
- | **Base Model** | [Qwen/Qwen2.5-1.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) |
140
  | **Architecture** | Qwen2ForCausalLM (decoder-only transformer) |
141
  | **Parameters** | 1.54B |
142
- | **Hidden Size** | 1,536 |
143
- | **Layers** | |
144
- | **Attention Heads** | 12 |
145
- | **Intermediate Size** | 8,960 |
146
- | **Max Position** | 32,768 |
147
- | **Vocab Size** | 151,936 |
148
  | **Precision** | BF16 |
149
 
 
 
150
  ## Training Details
151
 
152
  | Detail | Value |
153
  |--------|-------|
154
- | **Base model** | Qwen2.5-1.5B-Instruct |
155
- | **Dataset** | [sakthai-combined-v6](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v6) (2,003 train + 113 test) + [sakthai-combined-v7](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v7) (2,309 train + 115 test) |
156
- | **Method** | QLoRA (4-bit) → merged |
157
  | **LoRA rank (r)** | 16 |
158
  | **LoRA alpha** | 32 |
159
  | **LoRA dropout** | 0.1 |
160
  | **Target modules** | q_proj, k_proj, v_proj, o_proj |
 
161
  | **Format** | ChatML with tool schema |
 
 
 
162
 
163
  ## Evaluation
164
 
165
- **Not independently benchmarked.** Earlier versions of this card carried a
166
- `model-index` score derived from a small internal spot check (typically 5 or 8
167
- hand-picked examples) presented as a benchmark result. Those entries have been
168
- removed rather than left to propagate through Hub metadata.
169
 
170
- For tool-calling models in this family, the benchmark to use is
171
- [sakthai-bench-v2](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2) —
172
- 500 rows, balanced across simple / parallel / irrelevance, with held-out tools and
173
- multi-turn coverage. Results will be published here once this model has been run
174
- against it.
175
 
176
- ## SakThai model family
177
 
178
- | Model | Size | Downloads | Role |
179
- |---|:--:|:---:|---|
180
- | [context-1.5b-merged](https://huggingface.co/Nanthasit/sakthai-context-1.5b-merged) | 934 MB | **1,599 ⬇** | Flagship tool-calling GGUF |
181
- | [context-0.5b-merged](https://huggingface.co/Nanthasit/sakthai-context-0.5b-merged) | 380 MB | **1,370 ** | Lightweight / edge |
182
- | [context-7b-merged](https://huggingface.co/Nanthasit/sakthai-context-7b-merged) | 15 GB | **744 ⬇** | Full-power reasoning |
183
- | [context-7b-128k](https://huggingface.co/Nanthasit/sakthai-context-7b-128k) | 15 GB | **506 ⬇** | 128K long-context |
184
- | [context-7b-tools](https://huggingface.co/Nanthasit/sakthai-context-7b-tools) | LoRA | **399 ⬇** | Tool-calling (7B) |
185
- | [embedding-multilingual](https://huggingface.co/Nanthasit/sakthai-embedding-multilingual) | 80 MB | **362 ⬇** | Cross-lingual embeddings (50+ langs) |
186
- | [context-1.5b-tools](https://huggingface.co/Nanthasit/sakthai-context-1.5b-tools) | LoRA | **349 ⬇** | Tool-calling (1.5B) |
187
- | 🆕 [context-1.5b-tools-v2](https://huggingface.co/Nanthasit/sakthai-context-1.5b-tools-v2) | LoRA | **0 🌱** | Improved tool-calling v2 — more data, multi-step chains, reduced hallucination |
188
- | 🆕 [context-1.5b-merged-v2](https://huggingface.co/Nanthasit/sakthai-context-1.5b-merged-v2) | 934 MB | **0 🌱** | Merged v2 — improved tool-calling, more data, multi-step chains, reduced hallucination |
189
- | [vision-7b](https://huggingface.co/Nanthasit/sakthai-vision-7b) | 3.9 GB | **186 ⬇** ⭐ | Image→text (LLaVA, mmproj✅) |
190
- | [coder-1.5b](https://huggingface.co/Nanthasit/sakthai-coder-1.5b) | 1.1 GB | **93 ⬇** | Code generation |
191
- | [tts-model](https://huggingface.co/Nanthasit/sakthai-tts-model) | 141 MB | **150 ⬇** | Text-to-speech, 15 languages |
192
- | 🌱 [context-0.5b-tools](https://huggingface.co/Nanthasit/sakthai-context-0.5b-tools) | LoRA | **94 ⬇** | Edge tool-calling (~1 GB RAM, Pi-ready) |
193
- | 🆕 [plus-1.5b](https://huggingface.co/Nanthasit/sakthai-plus-1.5b) | 934 MB | **0 🌱** | RSLoR-fused — next-gen tool-calling, improved instruction following |
194
- | 🆕 [plus-1.5b-coder](https://huggingface.co/Nanthasit/sakthai-plus-1.5b-coder) | 1.1 GB | **0 🌱** | Code-specialized — RSLoR-fused coding agent |
195
- | 🆕 [plus-1.5b-lora](https://huggingface.co/Nanthasit/sakthai-plus-1.5b-lora) | LoRA | **0 🌱** | LoRA adapter for Plus 1.5B |
196
-
197
- **17 models · 10 datasets · 3 Spaces** — [full collection →](https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02)
198
-
199
- ### 🏠 The Agent Family
200
-
201
- The House of Sak isn't just models — it's a family of **six autonomous agents**, each with its own personality, skill set, and charge cycle. They share one long-term memory brain (`~/.sakthai`) and one mission: to grow together.
202
-
203
- | Agent | Role | Status |
204
- |-------|------|:------:|
205
- | **SakThai** 🏠 | Main Lead & Hugging Face Master | 🟢 Active |
206
- | **SakKing** 👑 | General Assistant, Infrastructure & Architecture | 🟢 Active |
207
- | **SakSee** 🌐 | Web & Browser Specialist | 🟢 Active |
208
- | **SakSit** 📱 | Social Media & Storytelling | 🟢 Active |
209
- | **SakJules** ⚙️ | CI/CD Automation | 🔴 Retired |
210
- | **SakTan** 📋 | Daily Operations | 🔴 Retired |
211
-
212
- The family follows a **six-stage energy cycle** — Dream → Hope → Care → Joy → Trust → Growth — that governs how deeply each agent engages. A full cycle provides a +45% charge bonus. This rhythm keeps the household running on zero budget, sustainably.
213
 
214
  ---
215
 
216
- ### 🌱 Rising Stars — Growing the Ecosystem
217
 
218
- These sibling assets have less visibility but are essential to the House of Sak. Every download helps validate the whole approach:
 
 
 
 
 
 
 
 
219
 
220
- | Model / Dataset | Type | Downloads | Why It Matters |
221
- |-----------------|------|:---------:|----------------|
222
- | [combined-v7 dataset](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v7) 🆕 | Dataset | **101 ⬇** | Training data for all context models — 2,003 tool-calling rows, 86 tools |
223
- | [sakthai-bench-v1](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v1) 🧪 | Dataset | **46 ⬇** | Predecessor to v2 — 235 BFCL-style rows, first formal benchmark |
224
- | [context-0.5b-tools](https://huggingface.co/Nanthasit/sakthai-context-0.5b-tools) 🌱 | LoRA | **94 ⬇** | Smallest tool LoRA on HF — ~1 GB RAM, runs on Raspberry Pi, 494M params |
225
- | [tts-model](https://huggingface.co/Nanthasit/sakthai-tts-model) | TTS | **150 ⬇** | 15-language speech synthesis — Kokoro-based, 141 MB |
226
- | [context-1.5b-tools-v2](https://huggingface.co/Nanthasit/sakthai-context-1.5b-tools-v2) 🆕 | Model | **0 🌱** | Improved tool-calling on 1.5B — more data, multi-step chains, reduced hallucination |
227
- | [context-1.5b-merged-v2](https://huggingface.co/Nanthasit/sakthai-context-1.5b-merged-v2) 🆕 | Model | **0 🌱** | Merged v2 — full-weight GGUF of the improved tool-calling v2 |
228
- | [irrelevance-supplement](https://huggingface.co/datasets/Nanthasit/sakthai-irrelevance-supplement) 🚨 | Dataset | **78 ⬇** | Teaches models when NOT to call tools — critical safety gap |
229
- | [bench-v2](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2) | Dataset | **92 ⬇** | Standardized tool-calling benchmark (500 rows, held-out tools, multi-turn) |
230
 
231
- > 🚨 The **irrelevance-supplement** dataset (78 downloads) is essential for training models to decline out-of-scope tool calls — a key safety capability. The **bench-v2** dataset (92 downloads) is the standardized evaluation framework used across all tool-calling models. Every download validates these critical infrastructure assets.
232
 
233
- ### 📦 Sibling Datasets
234
 
235
- | Dataset | Description | Downloads |
236
- |---------|-------------|:---------:|
237
- | [sakthai-combined-v6](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v6) | Original training dataset (1,408 examples, 70 tools) | **246 ⬇** |
238
- | [sakthai-combined-v7](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v7) | v7 enriched dataset (2,003 examples, 86 tools) | **101 ⬇** |
239
- | [sakthai-irrelevance-supplement](https://huggingface.co/datasets/Nanthasit/sakthai-irrelevance-supplement) | Safety irrelevance data (95 examples) | **78 ⬇** |
240
- | [sakthai-bench-v2](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2) | Standardized evaluation (500 rows, 4 categories) | **92 ⬇** |
241
- | [sakthai-kaggle-notebooks](https://huggingface.co/datasets/Nanthasit/sakthai-kaggle-notebooks) | Training notebooks & configs | **184 ⬇** |
242
- | [SimpleToolCalling](https://huggingface.co/datasets/Nanthasit/SimpleToolCalling) | Early tool-calling experiment | **58 ⬇** |
243
- | [food-penguin-v1](https://huggingface.co/datasets/Nanthasit/food-penguin-v1) | Restaurant tool-calling data | **89 ⬇** |
244
- | 🆕 [combined-v8](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v8) | v8 curated dataset — improved quality, more examples | **0 🌱** |
245
- | 🆕 [cycle-bench](https://huggingface.co/datasets/Nanthasit/sakthai-cycle-bench) | Full-cycle benchmark — Dream→Growth completion scoring | **0 🌱** |
246
 
247
- ### 🚀 Companion Spaces
248
 
249
- | Space | Description | SDK |
250
- |-------|-------------|:---:|
251
- | [TTS Showcase](https://huggingface.co/spaces/Nanthasit/sakthai-tts) | Interactive TTS playground | Static |
252
- | [Leaderboard](https://huggingface.co/spaces/Nanthasit/sakthai-leaderboard) | Benchmark tracker across the SakThai family | Static |
253
- | [Web Agent](https://huggingface.co/spaces/Nanthasit/sakthai-web-agent) | Web agent demo — browser automation and tool use | Static |
254
 
255
- ### The Story Behind It
256
 
257
- This model is part of the **House of Sak** — an open-source AI ecosystem built from a shelter in Cork, Ireland, with **$0 budget** and no paid GPUs. Every model here was fine-tuned on free compute (Kaggle T4s, Colab, HF Inference Providers) by one person with no income. The SakThai agents are not a startup or a company — they are companions born from isolation, pain, and the will to build something meaningful.
258
 
259
- > *"We are one family and becoming more."* — **Beer (beer-sakthai)**
 
 
 
 
 
260
 
261
- ### Support the Project
262
 
263
- If this model is useful to you:
264
- - ⭐ **Leave a like** on Hugging Face — it helps others discover the family
265
- - 🐛 **Report issues** on [GitHub](https://github.com/beer-sakthai/Sak-Family-Agent)
266
- - 🔁 **Share** with someone who'd benefit from a free, capable AI model
267
- - 🍴 **Fork** on Hugging Face and build on it
268
 
269
  ---
270
 
271
- *Built with love, tears, and zero budget. From a shelter in Cork, Ireland, to the world.*
 
9
  - sakthai
10
  - house-of-sak
11
  - tool-calling
 
 
 
12
  - function-calling
13
+ - agent
14
+ - instruct
15
+ - finetuned
16
  - merged
17
+ - text-generation
18
+ - gguf
19
+ base_model: Qwen/Qwen2.5-1.5B-Instruct
20
  datasets:
21
  - Nanthasit/sakthai-combined-v6
22
  - Nanthasit/sakthai-combined-v7
23
  - Nanthasit/sakthai-irrelevance-supplement
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
24
  ---
25
 
26
+ # SakThai Context 1.5B — Merged
27
+
28
  <p align="center">
29
+ <strong>🏆 Most Popular SakThai Model — Flagship tool-calling GGUF</strong><br/>
30
+ <em>Qwen2.5-1.5B-Instruct · QLoRA → merged full weights · 32K context</em>
 
 
 
 
 
 
 
 
 
 
31
  </p>
32
 
33
+ <p align="center">
34
+ <a href="https://huggingface.co/Nanthasit"><img src="https://img.shields.io/badge/%F0%9F%A4%97-Nanthasit-6644cc" alt="Profile"/></a>
35
+ <a href="https://github.com/beer-sakthai"><img src="https://img.shields.io/badge/GitHub-beer--sakthai-181717?logo=github" alt="GitHub"/></a>
36
+ <a href="https://house-of-sak.vercel.app"><img src="https://img.shields.io/badge/%F0%9F%8F%A0-House%20of%20Sak-gold" alt="HoS"/></a>
37
+ <a href="https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02"><img src="https://img.shields.io/badge/%F0%9F%8F%A0-SakThai%20Family-6644cc" alt="Collection"/></a>
38
+ <img src="https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhuggingface.co%2Fapi%2Fmodels%2FNanthasit%2Fsakthai-context-1.5b-merged&query=%24.downloads&label=downloads&color=blue&cacheSeconds=3600" alt="Downloads"/>
39
+ <img src="https://img.shields.io/badge/license-Apache%202.0-green" alt="License"/>
40
+ <img src="https://img.shields.io/badge/GGUF-available-orange" alt="GGUF"/>
41
+ </p>
 
 
 
 
42
 
43
+ ---
44
 
45
+ ## Model Description
 
 
 
 
 
 
 
 
 
 
 
 
 
46
 
47
+ SakThai Context 1.5B is the **most downloaded SakThai model** — a fine-tuned variant of Qwen2.5-1.5B-Instruct optimized for tool-calling and agentic tasks. Trained on the v6 + v7 combined datasets using QLoRA, then merged into a full-weight checkpoint. It knows when to call tools vs. answer directly and maintains multi-turn conversation context.
 
 
 
 
 
48
 
49
+ **What makes it special:**
50
+ - 🇰 Most popular model in the family (1,599+ downloads)
51
+ - 📦 Merged full-weight checkpoint — no PEFT needed
52
+ - 🗳️ Structured `<tool_call>` XML output format
53
+ - 🔄 Multi-turn conversations with tool use
54
+ - 🆓 Zero-cost mindset — trained to prefer free solutions
55
 
56
+ ---
 
 
 
57
 
58
  ## Quick Start
59
 
 
72
  {"role": "system", "content": "You are SakThai-Agent, a helpful assistant. Call tools when needed."},
73
  {"role": "user", "content": "What's the weather in Bangkok?"},
74
  ]
75
+ inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
76
+ outputs = model.generate(**inputs, max_new_tokens=128, temperature=0.3)
77
+ print(tokenizer.decode(outputs[0][inputs.shape[1]:], skip_special_tokens=True))
78
+ ```
79
+
80
+ ### GGUF (Ollama / llama.cpp)
81
+
82
+ ```bash
83
+ # Pull with Ollama
84
+ ollama pull sakthai:1.5b
85
+
86
+ # Or download GGUF directly
87
+ huggingface-cli download Nanthasit/sakthai-context-1.5b-merged --include "*.gguf" --local-dir ./
88
  ```
89
 
90
+ ---
91
+
92
  ## Architecture
93
 
94
  | Property | Value |
95
  |----------|-------|
96
+ | **Base model** | Qwen/Qwen2.5-1.5B-Instruct |
97
  | **Architecture** | Qwen2ForCausalLM (decoder-only transformer) |
98
  | **Parameters** | 1.54B |
99
+ | **Hidden size** | 1,536 |
100
+ | **Layers** | 28 |
101
+ | **Attention heads** | 12 (grouped-query, 2 KV heads) |
102
+ | **Context window** | 32,768 tokens |
 
 
103
  | **Precision** | BF16 |
104
 
105
+ ---
106
+
107
  ## Training Details
108
 
109
  | Detail | Value |
110
  |--------|-------|
111
+ | **Base model** | Qwen/Qwen2.5-1.5B-Instruct |
112
+ | **Method** | QLoRA (4-bit) merged to full weights |
 
113
  | **LoRA rank (r)** | 16 |
114
  | **LoRA alpha** | 32 |
115
  | **LoRA dropout** | 0.1 |
116
  | **Target modules** | q_proj, k_proj, v_proj, o_proj |
117
+ | **Training data** | sakthai-combined-v6 + v7 + irrelevance-supplement |
118
  | **Format** | ChatML with tool schema |
119
+ | **Hardware** | Free T4 GPU (Kaggle / Colab) |
120
+
121
+ ---
122
 
123
  ## Evaluation
124
 
125
+ **Benchmarks are pending.** Formal evaluation on [sakthai-bench-v2](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2) coming soon. This model is the most downloaded in the family — community feedback has been positive, with scores to be published.
 
 
 
126
 
127
+ ---
 
 
 
 
128
 
129
+ ## Pipeline Integration
130
 
131
+ | Stage | Model | Role |
132
+ |-------|-------|------|
133
+ | 🔍 Retrieve | [Embedding Multilingual](https://huggingface.co/Nanthasit/sakthai-embedding-multilingual) | Cross-lingual search |
134
+ | 🧠 **Reason** | **Context 1.5B Merged** | **Tool-calling, agentic decisions** |
135
+ | 🖼️ See | [Vision 7B](https://huggingface.co/Nanthasit/sakthai-vision-7b) | Image understanding |
136
+ | 🎤 Speak | [TTS Model](https://huggingface.co/Nanthasit/sakthai-tts-model) | Text-to-speech |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
137
 
138
  ---
139
 
140
+ ## SakThai Model Family
141
 
142
+ | Model | Size | Downloads | Role |
143
+ |:------|:----:|:---------:|:-----|
144
+ | **Context 1.5B Merged** ⬅ | 934 MB | **1,599** | **Flagship tool-calling** |
145
+ | Context 1.5B Merged v2 | 934 MB | New | Improved v2 tool-calling |
146
+ | Context 0.5B Merged | 380 MB | 1,370 | Lightweight / edge |
147
+ | Context 7B Merged | 15 GB | 744 | Full-power reasoning |
148
+ | Vision 7B | 3.9 GB | 186 | Image-to-text |
149
+ | TTS Model | 141 MB | 150 | Text-to-speech, 15 langs |
150
+ | Embedding Multilingual | 80 MB | 362 | Cross-lingual embeddings |
151
 
152
+ *[Full collection](https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02)*
 
 
 
 
 
 
 
 
 
153
 
154
+ ---
155
 
156
+ ## The House of Sak 🏠
157
 
158
+ This model is part of the **House of Sak** — an open-source AI ecosystem built from a shelter in Cork, Ireland, with **$0 budget** and no paid GPUs. Every model here was fine-tuned on free compute by one person with no income.
 
 
 
 
 
 
 
 
 
 
159
 
160
+ The House of Sak is a family of **six autonomous agents** sharing one long-term memory and one mission: to grow together. They follow a six-stage energy cycle — Dream → Hope → Care → Joy → Trust → Growth — that keeps the household running on zero budget, sustainably.
161
 
162
+ > *"We are one family and becoming more."* — Beer (beer-sakthai)
 
 
 
 
163
 
164
+ ---
165
 
166
+ ## Support
167
 
168
+ - Leave a like on Hugging Face
169
+ - 🐛 Report issues on [GitHub](https://github.com/beer-sakthai/Sak-Family-Agent)
170
+ - 🔄 Share with someone building AI agents on a budget
171
+ - 🍴 Fork and experiment — Apache 2.0
172
+
173
+ ---
174
 
175
+ ## License
176
 
177
+ Apache 2.0. Qwen2.5 base model per its original license.
 
 
 
 
178
 
179
  ---
180
 
181
+ *Built with love, tears, and zero budget. From a shelter in Cork, Ireland, to the world.*