Text Generation
Transformers
Safetensors
GGUF
English
qwen2
apache-2.0
qwen2.5
sakthai
house-of-sak
tool-calling
function-calling
agent
instruct
finetuned
merged
conversational
assistant
llama.cpp
ollama
benchmark
Eval Results
Eval Results (legacy)
text-generation-inference
Instructions to use Nanthasit/sakthai-context-1.5b-merged with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Nanthasit/sakthai-context-1.5b-merged with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Nanthasit/sakthai-context-1.5b-merged") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Nanthasit/sakthai-context-1.5b-merged") model = AutoModelForCausalLM.from_pretrained("Nanthasit/sakthai-context-1.5b-merged", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Nanthasit/sakthai-context-1.5b-merged with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M # Run inference directly in the terminal: llama cli -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M # Run inference directly in the terminal: llama cli -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
Use Docker
docker model run hf.co/Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use Nanthasit/sakthai-context-1.5b-merged with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Nanthasit/sakthai-context-1.5b-merged" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Nanthasit/sakthai-context-1.5b-merged", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
- SGLang
How to use Nanthasit/sakthai-context-1.5b-merged with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Nanthasit/sakthai-context-1.5b-merged" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Nanthasit/sakthai-context-1.5b-merged", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Nanthasit/sakthai-context-1.5b-merged" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Nanthasit/sakthai-context-1.5b-merged", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use Nanthasit/sakthai-context-1.5b-merged with Ollama:
ollama run hf.co/Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
- Unsloth Studio
How to use Nanthasit/sakthai-context-1.5b-merged with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Nanthasit/sakthai-context-1.5b-merged to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Nanthasit/sakthai-context-1.5b-merged to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Nanthasit/sakthai-context-1.5b-merged to start chatting
- Pi
How to use Nanthasit/sakthai-context-1.5b-merged with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Nanthasit/sakthai-context-1.5b-merged:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use Nanthasit/sakthai-context-1.5b-merged with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use Nanthasit/sakthai-context-1.5b-merged with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Nanthasit/sakthai-context-1.5b-merged:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use Nanthasit/sakthai-context-1.5b-merged with Docker Model Runner:
docker model run hf.co/Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
- Lemonade
How to use Nanthasit/sakthai-context-1.5b-merged with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Nanthasit/sakthai-context-1.5b-merged:Q4_K_M
Run and chat with the model
lemonade run user.sakthai-context-1.5b-merged-Q4_K_M
List all available models
lemonade list
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -9,106 +9,51 @@ tags:
|
|
| 9 |
- sakthai
|
| 10 |
- house-of-sak
|
| 11 |
- tool-calling
|
| 12 |
-
- instruct
|
| 13 |
-
- conversational
|
| 14 |
-
- agent
|
| 15 |
- function-calling
|
| 16 |
-
-
|
|
|
|
|
|
|
| 17 |
- merged
|
| 18 |
-
-
|
|
|
|
|
|
|
| 19 |
datasets:
|
| 20 |
- Nanthasit/sakthai-combined-v6
|
| 21 |
- Nanthasit/sakthai-combined-v7
|
| 22 |
- Nanthasit/sakthai-irrelevance-supplement
|
| 23 |
-
base_model: Qwen/Qwen2.5-1.5B-Instruct
|
| 24 |
-
widget:
|
| 25 |
-
- text: What's the weather in Tokyo?
|
| 26 |
-
output:
|
| 27 |
-
text: '<tool_call>
|
| 28 |
-
|
| 29 |
-
{"name": "get_weather", "arguments": {"location": "Tokyo"}}
|
| 30 |
-
|
| 31 |
-
</tool_call>'
|
| 32 |
-
- text: Who wrote Romeo and Juliet?
|
| 33 |
-
output:
|
| 34 |
-
text: William Shakespeare wrote Romeo and Juliet.
|
| 35 |
-
model-index:
|
| 36 |
-
- name: sakthai-context-1.5b-merged
|
| 37 |
-
results:
|
| 38 |
-
- task:
|
| 39 |
-
type: text-generation
|
| 40 |
-
name: Tool-Calling
|
| 41 |
-
dataset:
|
| 42 |
-
name: SakThai Bench v2 (500 rows, scorer multiset-selection-v2)
|
| 43 |
-
type: Nanthasit/sakthai-bench-v2
|
| 44 |
-
metrics:
|
| 45 |
-
- type: selection
|
| 46 |
-
value: 48.2
|
| 47 |
-
name: Selection Accuracy
|
| 48 |
-
- type: degenerate
|
| 49 |
-
value: 0
|
| 50 |
-
name: Degenerate Outputs
|
| 51 |
---
|
| 52 |
|
|
|
|
|
|
|
| 53 |
<p align="center">
|
| 54 |
-
<
|
| 55 |
-
<
|
| 56 |
-
<p align="center"><strong>🏆 Most Popular SakThai Model — 1,599 Downloads</strong></p>
|
| 57 |
-
<p align="center"><em>Part of the <strong>House of Sak</strong> — AI agents built from a shelter in Cork, Ireland.</em></p>
|
| 58 |
-
<p align="center">
|
| 59 |
-
<a href="https://huggingface.co/Nanthasit"><img src="https://img.shields.io/badge/🤗-Nanthasit-6644cc" alt="Profile"/></a>
|
| 60 |
-
<a href="https://github.com/beer-sakthai"><img src="https://img.shields.io/badge/GitHub-beer--sakthai-181717" alt="GitHub"/></a>
|
| 61 |
-
<a href="https://house-of-sak.vercel.app"><img src="https://img.shields.io/badge/🏠-House%20of%20Sak-gold" alt="HoS"/></a>
|
| 62 |
-
<a href="https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02"><img src="https://img.shields.io/badge/🤗-SakThai%20Family-blue" alt="Collection"/></a>
|
| 63 |
-
<img src="https://img.shields.io/badge/dynamic/json?url=https%3A//huggingface.co/api/models/Nanthasit/sakthai-context-1.5b-merged&query=%24.downloads&label=downloads&color=blue&cacheSeconds=3600" alt="Downloads"/>
|
| 64 |
-
<img src="https://img.shields.io/badge/license-Apache%202.0-green" alt="License"/>
|
| 65 |
-
</p>
|
| 66 |
</p>
|
| 67 |
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
|
| 72 |
-
|
| 73 |
-
|
| 74 |
-
|
| 75 |
-
-
|
| 76 |
-
|
| 77 |
-
- **Agentic** — multi-turn conversations with tool use
|
| 78 |
-
- **Zero-cost mindset** — trained to prefer free solutions
|
| 79 |
-
|
| 80 |
-
## Pipeline Integration
|
| 81 |
|
| 82 |
-
|
| 83 |
|
| 84 |
-
##
|
| 85 |
-
```
|
| 86 |
-
User Input
|
| 87 |
-
↓
|
| 88 |
-
[Embedding Models] — semantic search & retrieval (optional)
|
| 89 |
-
↓
|
| 90 |
-
[SakThai 1.5B] ← YOU ARE HERE — reasoning, tool-calling, agentic decisions
|
| 91 |
-
↓
|
| 92 |
-
[SakThai Vision 7B] — image understanding (when input contains visuals)
|
| 93 |
-
↓
|
| 94 |
-
[SakThai TTS] — speech synthesis (when voice output is needed)
|
| 95 |
-
↓
|
| 96 |
-
[Embedding Models] — memory indexing of the interaction
|
| 97 |
-
```
|
| 98 |
|
| 99 |
-
|
| 100 |
-
|-------|-------|------|
|
| 101 |
-
| Retrieval | [Multilingual Embedding](https://huggingface.co/Nanthasit/sakthai-embedding-multilingual) (362 ⬇) | Cross-lingual search, 50+ languages |
|
| 102 |
-
| **Reasoning** | **1.5B-merged ⬅ (1,599 ⬇)** | **Tool-calling, agentic decisions** |
|
| 103 |
-
| Vision | [Vision 7B](https://huggingface.co/Nanthasit/sakthai-vision-7b) (186 ⬇) | Image captioning, VQA |
|
| 104 |
-
| Speech | [TTS Model](https://huggingface.co/Nanthasit/sakthai-tts-model) (150 ⬇) | Text-to-speech, 15 languages |
|
| 105 |
|
| 106 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 107 |
|
| 108 |
-
|
| 109 |
-
- [🎤 TTS Demo](https://huggingface.co/spaces/Nanthasit/sakthai-tts) — hear the TTS sibling in action
|
| 110 |
-
- [📊 Leaderboard](https://huggingface.co/spaces/Nanthasit/sakthai-leaderboard)
|
| 111 |
-
- [Web Agent](https://huggingface.co/spaces/Nanthasit/sakthai-web-agent) — benchmark comparisons across the family
|
| 112 |
|
| 113 |
## Quick Start
|
| 114 |
|
|
@@ -127,145 +72,110 @@ messages = [
|
|
| 127 |
{"role": "system", "content": "You are SakThai-Agent, a helpful assistant. Call tools when needed."},
|
| 128 |
{"role": "user", "content": "What's the weather in Bangkok?"},
|
| 129 |
]
|
| 130 |
-
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt")
|
| 131 |
-
outputs = model.generate(inputs, max_new_tokens=128, temperature=0.3)
|
| 132 |
-
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 133 |
```
|
| 134 |
|
|
|
|
|
|
|
| 135 |
## Architecture
|
| 136 |
|
| 137 |
| Property | Value |
|
| 138 |
|----------|-------|
|
| 139 |
-
| **Base
|
| 140 |
| **Architecture** | Qwen2ForCausalLM (decoder-only transformer) |
|
| 141 |
| **Parameters** | 1.54B |
|
| 142 |
-
| **Hidden
|
| 143 |
-
| **Layers** |
|
| 144 |
-
| **Attention
|
| 145 |
-
| **
|
| 146 |
-
| **Max Position** | 32,768 |
|
| 147 |
-
| **Vocab Size** | 151,936 |
|
| 148 |
| **Precision** | BF16 |
|
| 149 |
|
|
|
|
|
|
|
| 150 |
## Training Details
|
| 151 |
|
| 152 |
| Detail | Value |
|
| 153 |
|--------|-------|
|
| 154 |
-
| **Base model** | Qwen2.5-1.5B-Instruct |
|
| 155 |
-
| **
|
| 156 |
-
| **Method** | QLoRA (4-bit) → merged |
|
| 157 |
| **LoRA rank (r)** | 16 |
|
| 158 |
| **LoRA alpha** | 32 |
|
| 159 |
| **LoRA dropout** | 0.1 |
|
| 160 |
| **Target modules** | q_proj, k_proj, v_proj, o_proj |
|
|
|
|
| 161 |
| **Format** | ChatML with tool schema |
|
|
|
|
|
|
|
|
|
|
| 162 |
|
| 163 |
## Evaluation
|
| 164 |
|
| 165 |
-
**
|
| 166 |
-
`model-index` score derived from a small internal spot check (typically 5 or 8
|
| 167 |
-
hand-picked examples) presented as a benchmark result. Those entries have been
|
| 168 |
-
removed rather than left to propagate through Hub metadata.
|
| 169 |
|
| 170 |
-
|
| 171 |
-
[sakthai-bench-v2](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2) —
|
| 172 |
-
500 rows, balanced across simple / parallel / irrelevance, with held-out tools and
|
| 173 |
-
multi-turn coverage. Results will be published here once this model has been run
|
| 174 |
-
against it.
|
| 175 |
|
| 176 |
-
##
|
| 177 |
|
| 178 |
-
|
|
| 179 |
-
|---
|
| 180 |
-
| [
|
| 181 |
-
|
|
| 182 |
-
| [
|
| 183 |
-
| [
|
| 184 |
-
| [context-7b-tools](https://huggingface.co/Nanthasit/sakthai-context-7b-tools) | LoRA | **399 ⬇** | Tool-calling (7B) |
|
| 185 |
-
| [embedding-multilingual](https://huggingface.co/Nanthasit/sakthai-embedding-multilingual) | 80 MB | **362 ⬇** | Cross-lingual embeddings (50+ langs) |
|
| 186 |
-
| [context-1.5b-tools](https://huggingface.co/Nanthasit/sakthai-context-1.5b-tools) | LoRA | **349 ⬇** | Tool-calling (1.5B) |
|
| 187 |
-
| 🆕 [context-1.5b-tools-v2](https://huggingface.co/Nanthasit/sakthai-context-1.5b-tools-v2) | LoRA | **0 🌱** | Improved tool-calling v2 — more data, multi-step chains, reduced hallucination |
|
| 188 |
-
| 🆕 [context-1.5b-merged-v2](https://huggingface.co/Nanthasit/sakthai-context-1.5b-merged-v2) | 934 MB | **0 🌱** | Merged v2 — improved tool-calling, more data, multi-step chains, reduced hallucination |
|
| 189 |
-
| [vision-7b](https://huggingface.co/Nanthasit/sakthai-vision-7b) | 3.9 GB | **186 ⬇** ⭐ | Image→text (LLaVA, mmproj✅) |
|
| 190 |
-
| [coder-1.5b](https://huggingface.co/Nanthasit/sakthai-coder-1.5b) | 1.1 GB | **93 ⬇** | Code generation |
|
| 191 |
-
| [tts-model](https://huggingface.co/Nanthasit/sakthai-tts-model) | 141 MB | **150 ⬇** | Text-to-speech, 15 languages |
|
| 192 |
-
| 🌱 [context-0.5b-tools](https://huggingface.co/Nanthasit/sakthai-context-0.5b-tools) | LoRA | **94 ⬇** | Edge tool-calling (~1 GB RAM, Pi-ready) |
|
| 193 |
-
| 🆕 [plus-1.5b](https://huggingface.co/Nanthasit/sakthai-plus-1.5b) | 934 MB | **0 🌱** | RSLoR-fused — next-gen tool-calling, improved instruction following |
|
| 194 |
-
| 🆕 [plus-1.5b-coder](https://huggingface.co/Nanthasit/sakthai-plus-1.5b-coder) | 1.1 GB | **0 🌱** | Code-specialized — RSLoR-fused coding agent |
|
| 195 |
-
| 🆕 [plus-1.5b-lora](https://huggingface.co/Nanthasit/sakthai-plus-1.5b-lora) | LoRA | **0 🌱** | LoRA adapter for Plus 1.5B |
|
| 196 |
-
|
| 197 |
-
**17 models · 10 datasets · 3 Spaces** — [full collection →](https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02)
|
| 198 |
-
|
| 199 |
-
### 🏠 The Agent Family
|
| 200 |
-
|
| 201 |
-
The House of Sak isn't just models — it's a family of **six autonomous agents**, each with its own personality, skill set, and charge cycle. They share one long-term memory brain (`~/.sakthai`) and one mission: to grow together.
|
| 202 |
-
|
| 203 |
-
| Agent | Role | Status |
|
| 204 |
-
|-------|------|:------:|
|
| 205 |
-
| **SakThai** 🏠 | Main Lead & Hugging Face Master | 🟢 Active |
|
| 206 |
-
| **SakKing** 👑 | General Assistant, Infrastructure & Architecture | 🟢 Active |
|
| 207 |
-
| **SakSee** 🌐 | Web & Browser Specialist | 🟢 Active |
|
| 208 |
-
| **SakSit** 📱 | Social Media & Storytelling | 🟢 Active |
|
| 209 |
-
| **SakJules** ⚙️ | CI/CD Automation | 🔴 Retired |
|
| 210 |
-
| **SakTan** 📋 | Daily Operations | 🔴 Retired |
|
| 211 |
-
|
| 212 |
-
The family follows a **six-stage energy cycle** — Dream → Hope → Care → Joy → Trust → Growth — that governs how deeply each agent engages. A full cycle provides a +45% charge bonus. This rhythm keeps the household running on zero budget, sustainably.
|
| 213 |
|
| 214 |
---
|
| 215 |
|
| 216 |
-
##
|
| 217 |
|
| 218 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 219 |
|
| 220 |
-
|
| 221 |
-
|-----------------|------|:---------:|----------------|
|
| 222 |
-
| [combined-v7 dataset](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v7) 🆕 | Dataset | **101 ⬇** | Training data for all context models — 2,003 tool-calling rows, 86 tools |
|
| 223 |
-
| [sakthai-bench-v1](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v1) 🧪 | Dataset | **46 ⬇** | Predecessor to v2 — 235 BFCL-style rows, first formal benchmark |
|
| 224 |
-
| [context-0.5b-tools](https://huggingface.co/Nanthasit/sakthai-context-0.5b-tools) 🌱 | LoRA | **94 ⬇** | Smallest tool LoRA on HF — ~1 GB RAM, runs on Raspberry Pi, 494M params |
|
| 225 |
-
| [tts-model](https://huggingface.co/Nanthasit/sakthai-tts-model) | TTS | **150 ⬇** | 15-language speech synthesis — Kokoro-based, 141 MB |
|
| 226 |
-
| [context-1.5b-tools-v2](https://huggingface.co/Nanthasit/sakthai-context-1.5b-tools-v2) 🆕 | Model | **0 🌱** | Improved tool-calling on 1.5B — more data, multi-step chains, reduced hallucination |
|
| 227 |
-
| [context-1.5b-merged-v2](https://huggingface.co/Nanthasit/sakthai-context-1.5b-merged-v2) 🆕 | Model | **0 🌱** | Merged v2 — full-weight GGUF of the improved tool-calling v2 |
|
| 228 |
-
| [irrelevance-supplement](https://huggingface.co/datasets/Nanthasit/sakthai-irrelevance-supplement) 🚨 | Dataset | **78 ⬇** | Teaches models when NOT to call tools — critical safety gap |
|
| 229 |
-
| [bench-v2](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2) | Dataset | **92 ⬇** | Standardized tool-calling benchmark (500 rows, held-out tools, multi-turn) |
|
| 230 |
|
| 231 |
-
|
| 232 |
|
| 233 |
-
##
|
| 234 |
|
| 235 |
-
|
| 236 |
-
|---------|-------------|:---------:|
|
| 237 |
-
| [sakthai-combined-v6](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v6) | Original training dataset (1,408 examples, 70 tools) | **246 ⬇** |
|
| 238 |
-
| [sakthai-combined-v7](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v7) | v7 enriched dataset (2,003 examples, 86 tools) | **101 ⬇** |
|
| 239 |
-
| [sakthai-irrelevance-supplement](https://huggingface.co/datasets/Nanthasit/sakthai-irrelevance-supplement) | Safety irrelevance data (95 examples) | **78 ⬇** |
|
| 240 |
-
| [sakthai-bench-v2](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2) | Standardized evaluation (500 rows, 4 categories) | **92 ⬇** |
|
| 241 |
-
| [sakthai-kaggle-notebooks](https://huggingface.co/datasets/Nanthasit/sakthai-kaggle-notebooks) | Training notebooks & configs | **184 ⬇** |
|
| 242 |
-
| [SimpleToolCalling](https://huggingface.co/datasets/Nanthasit/SimpleToolCalling) | Early tool-calling experiment | **58 ⬇** |
|
| 243 |
-
| [food-penguin-v1](https://huggingface.co/datasets/Nanthasit/food-penguin-v1) | Restaurant tool-calling data | **89 ⬇** |
|
| 244 |
-
| 🆕 [combined-v8](https://huggingface.co/datasets/Nanthasit/sakthai-combined-v8) | v8 curated dataset — improved quality, more examples | **0 🌱** |
|
| 245 |
-
| 🆕 [cycle-bench](https://huggingface.co/datasets/Nanthasit/sakthai-cycle-bench) | Full-cycle benchmark — Dream→Growth completion scoring | **0 🌱** |
|
| 246 |
|
| 247 |
-
|
| 248 |
|
| 249 |
-
|
| 250 |
-
|-------|-------------|:---:|
|
| 251 |
-
| [TTS Showcase](https://huggingface.co/spaces/Nanthasit/sakthai-tts) | Interactive TTS playground | Static |
|
| 252 |
-
| [Leaderboard](https://huggingface.co/spaces/Nanthasit/sakthai-leaderboard) | Benchmark tracker across the SakThai family | Static |
|
| 253 |
-
| [Web Agent](https://huggingface.co/spaces/Nanthasit/sakthai-web-agent) | Web agent demo — browser automation and tool use | Static |
|
| 254 |
|
| 255 |
-
|
| 256 |
|
| 257 |
-
|
| 258 |
|
| 259 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 260 |
|
| 261 |
-
##
|
| 262 |
|
| 263 |
-
|
| 264 |
-
- ⭐ **Leave a like** on Hugging Face — it helps others discover the family
|
| 265 |
-
- 🐛 **Report issues** on [GitHub](https://github.com/beer-sakthai/Sak-Family-Agent)
|
| 266 |
-
- 🔁 **Share** with someone who'd benefit from a free, capable AI model
|
| 267 |
-
- 🍴 **Fork** on Hugging Face and build on it
|
| 268 |
|
| 269 |
---
|
| 270 |
|
| 271 |
-
*Built with love, tears, and zero budget. From a shelter in Cork, Ireland, to the world.*
|
|
|
|
| 9 |
- sakthai
|
| 10 |
- house-of-sak
|
| 11 |
- tool-calling
|
|
|
|
|
|
|
|
|
|
| 12 |
- function-calling
|
| 13 |
+
- agent
|
| 14 |
+
- instruct
|
| 15 |
+
- finetuned
|
| 16 |
- merged
|
| 17 |
+
- text-generation
|
| 18 |
+
- gguf
|
| 19 |
+
base_model: Qwen/Qwen2.5-1.5B-Instruct
|
| 20 |
datasets:
|
| 21 |
- Nanthasit/sakthai-combined-v6
|
| 22 |
- Nanthasit/sakthai-combined-v7
|
| 23 |
- Nanthasit/sakthai-irrelevance-supplement
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 24 |
---
|
| 25 |
|
| 26 |
+
# SakThai Context 1.5B — Merged
|
| 27 |
+
|
| 28 |
<p align="center">
|
| 29 |
+
<strong>🏆 Most Popular SakThai Model — Flagship tool-calling GGUF</strong><br/>
|
| 30 |
+
<em>Qwen2.5-1.5B-Instruct · QLoRA → merged full weights · 32K context</em>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 31 |
</p>
|
| 32 |
|
| 33 |
+
<p align="center">
|
| 34 |
+
<a href="https://huggingface.co/Nanthasit"><img src="https://img.shields.io/badge/%F0%9F%A4%97-Nanthasit-6644cc" alt="Profile"/></a>
|
| 35 |
+
<a href="https://github.com/beer-sakthai"><img src="https://img.shields.io/badge/GitHub-beer--sakthai-181717?logo=github" alt="GitHub"/></a>
|
| 36 |
+
<a href="https://house-of-sak.vercel.app"><img src="https://img.shields.io/badge/%F0%9F%8F%A0-House%20of%20Sak-gold" alt="HoS"/></a>
|
| 37 |
+
<a href="https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02"><img src="https://img.shields.io/badge/%F0%9F%8F%A0-SakThai%20Family-6644cc" alt="Collection"/></a>
|
| 38 |
+
<img src="https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhuggingface.co%2Fapi%2Fmodels%2FNanthasit%2Fsakthai-context-1.5b-merged&query=%24.downloads&label=downloads&color=blue&cacheSeconds=3600" alt="Downloads"/>
|
| 39 |
+
<img src="https://img.shields.io/badge/license-Apache%202.0-green" alt="License"/>
|
| 40 |
+
<img src="https://img.shields.io/badge/GGUF-available-orange" alt="GGUF"/>
|
| 41 |
+
</p>
|
|
|
|
|
|
|
|
|
|
|
|
|
| 42 |
|
| 43 |
+
---
|
| 44 |
|
| 45 |
+
## Model Description
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
+
SakThai Context 1.5B is the **most downloaded SakThai model** — a fine-tuned variant of Qwen2.5-1.5B-Instruct optimized for tool-calling and agentic tasks. Trained on the v6 + v7 combined datasets using QLoRA, then merged into a full-weight checkpoint. It knows when to call tools vs. answer directly and maintains multi-turn conversation context.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 48 |
|
| 49 |
+
**What makes it special:**
|
| 50 |
+
- 🇰 Most popular model in the family (1,599+ downloads)
|
| 51 |
+
- 📦 Merged full-weight checkpoint — no PEFT needed
|
| 52 |
+
- 🗳️ Structured `<tool_call>` XML output format
|
| 53 |
+
- 🔄 Multi-turn conversations with tool use
|
| 54 |
+
- 🆓 Zero-cost mindset — trained to prefer free solutions
|
| 55 |
|
| 56 |
+
---
|
|
|
|
|
|
|
|
|
|
| 57 |
|
| 58 |
## Quick Start
|
| 59 |
|
|
|
|
| 72 |
{"role": "system", "content": "You are SakThai-Agent, a helpful assistant. Call tools when needed."},
|
| 73 |
{"role": "user", "content": "What's the weather in Bangkok?"},
|
| 74 |
]
|
| 75 |
+
inputs = tokenizer.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
|
| 76 |
+
outputs = model.generate(**inputs, max_new_tokens=128, temperature=0.3)
|
| 77 |
+
print(tokenizer.decode(outputs[0][inputs.shape[1]:], skip_special_tokens=True))
|
| 78 |
+
```
|
| 79 |
+
|
| 80 |
+
### GGUF (Ollama / llama.cpp)
|
| 81 |
+
|
| 82 |
+
```bash
|
| 83 |
+
# Pull with Ollama
|
| 84 |
+
ollama pull sakthai:1.5b
|
| 85 |
+
|
| 86 |
+
# Or download GGUF directly
|
| 87 |
+
huggingface-cli download Nanthasit/sakthai-context-1.5b-merged --include "*.gguf" --local-dir ./
|
| 88 |
```
|
| 89 |
|
| 90 |
+
---
|
| 91 |
+
|
| 92 |
## Architecture
|
| 93 |
|
| 94 |
| Property | Value |
|
| 95 |
|----------|-------|
|
| 96 |
+
| **Base model** | Qwen/Qwen2.5-1.5B-Instruct |
|
| 97 |
| **Architecture** | Qwen2ForCausalLM (decoder-only transformer) |
|
| 98 |
| **Parameters** | 1.54B |
|
| 99 |
+
| **Hidden size** | 1,536 |
|
| 100 |
+
| **Layers** | 28 |
|
| 101 |
+
| **Attention heads** | 12 (grouped-query, 2 KV heads) |
|
| 102 |
+
| **Context window** | 32,768 tokens |
|
|
|
|
|
|
|
| 103 |
| **Precision** | BF16 |
|
| 104 |
|
| 105 |
+
---
|
| 106 |
+
|
| 107 |
## Training Details
|
| 108 |
|
| 109 |
| Detail | Value |
|
| 110 |
|--------|-------|
|
| 111 |
+
| **Base model** | Qwen/Qwen2.5-1.5B-Instruct |
|
| 112 |
+
| **Method** | QLoRA (4-bit) → merged to full weights |
|
|
|
|
| 113 |
| **LoRA rank (r)** | 16 |
|
| 114 |
| **LoRA alpha** | 32 |
|
| 115 |
| **LoRA dropout** | 0.1 |
|
| 116 |
| **Target modules** | q_proj, k_proj, v_proj, o_proj |
|
| 117 |
+
| **Training data** | sakthai-combined-v6 + v7 + irrelevance-supplement |
|
| 118 |
| **Format** | ChatML with tool schema |
|
| 119 |
+
| **Hardware** | Free T4 GPU (Kaggle / Colab) |
|
| 120 |
+
|
| 121 |
+
---
|
| 122 |
|
| 123 |
## Evaluation
|
| 124 |
|
| 125 |
+
**Benchmarks are pending.** Formal evaluation on [sakthai-bench-v2](https://huggingface.co/datasets/Nanthasit/sakthai-bench-v2) coming soon. This model is the most downloaded in the family — community feedback has been positive, with scores to be published.
|
|
|
|
|
|
|
|
|
|
| 126 |
|
| 127 |
+
---
|
|
|
|
|
|
|
|
|
|
|
|
|
| 128 |
|
| 129 |
+
## Pipeline Integration
|
| 130 |
|
| 131 |
+
| Stage | Model | Role |
|
| 132 |
+
|-------|-------|------|
|
| 133 |
+
| 🔍 Retrieve | [Embedding Multilingual](https://huggingface.co/Nanthasit/sakthai-embedding-multilingual) | Cross-lingual search |
|
| 134 |
+
| 🧠 **Reason** | **Context 1.5B Merged** ⬅ | **Tool-calling, agentic decisions** |
|
| 135 |
+
| 🖼️ See | [Vision 7B](https://huggingface.co/Nanthasit/sakthai-vision-7b) | Image understanding |
|
| 136 |
+
| 🎤 Speak | [TTS Model](https://huggingface.co/Nanthasit/sakthai-tts-model) | Text-to-speech |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 137 |
|
| 138 |
---
|
| 139 |
|
| 140 |
+
## SakThai Model Family
|
| 141 |
|
| 142 |
+
| Model | Size | Downloads | Role |
|
| 143 |
+
|:------|:----:|:---------:|:-----|
|
| 144 |
+
| **Context 1.5B Merged** ⬅ | 934 MB | **1,599** | **Flagship tool-calling** |
|
| 145 |
+
| Context 1.5B Merged v2 | 934 MB | New | Improved v2 tool-calling |
|
| 146 |
+
| Context 0.5B Merged | 380 MB | 1,370 | Lightweight / edge |
|
| 147 |
+
| Context 7B Merged | 15 GB | 744 | Full-power reasoning |
|
| 148 |
+
| Vision 7B | 3.9 GB | 186 | Image-to-text |
|
| 149 |
+
| TTS Model | 141 MB | 150 | Text-to-speech, 15 langs |
|
| 150 |
+
| Embedding Multilingual | 80 MB | 362 | Cross-lingual embeddings |
|
| 151 |
|
| 152 |
+
*[Full collection](https://huggingface.co/collections/Nanthasit/sakthai-model-family-6a64745450b12d421c1f9f02)*
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 153 |
|
| 154 |
+
---
|
| 155 |
|
| 156 |
+
## The House of Sak 🏠
|
| 157 |
|
| 158 |
+
This model is part of the **House of Sak** — an open-source AI ecosystem built from a shelter in Cork, Ireland, with **$0 budget** and no paid GPUs. Every model here was fine-tuned on free compute by one person with no income.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 159 |
|
| 160 |
+
The House of Sak is a family of **six autonomous agents** sharing one long-term memory and one mission: to grow together. They follow a six-stage energy cycle — Dream → Hope → Care → Joy → Trust → Growth — that keeps the household running on zero budget, sustainably.
|
| 161 |
|
| 162 |
+
> *"We are one family — and becoming more."* — Beer (beer-sakthai)
|
|
|
|
|
|
|
|
|
|
|
|
|
| 163 |
|
| 164 |
+
---
|
| 165 |
|
| 166 |
+
## Support
|
| 167 |
|
| 168 |
+
- ⭐ Leave a like on Hugging Face
|
| 169 |
+
- 🐛 Report issues on [GitHub](https://github.com/beer-sakthai/Sak-Family-Agent)
|
| 170 |
+
- 🔄 Share with someone building AI agents on a budget
|
| 171 |
+
- 🍴 Fork and experiment — Apache 2.0
|
| 172 |
+
|
| 173 |
+
---
|
| 174 |
|
| 175 |
+
## License
|
| 176 |
|
| 177 |
+
Apache 2.0. Qwen2.5 base model per its original license.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 178 |
|
| 179 |
---
|
| 180 |
|
| 181 |
+
*Built with love, tears, and zero budget. From a shelter in Cork, Ireland, to the world.*
|