File size: 2,984 Bytes
c79b7b8 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 | ---
license: mit
language:
- en
- ja
tags:
- gguf
- llama.cpp
- code-generation
- javascript
- typescript
- react
- nodejs
- slm
pipeline_tag: text-generation
---
# AI LocalQmod — JS-family Code SLMs (GGUF)
**Ultra-small, single-purpose code-generation models — as light as ~17 MB.**
This repository hosts a family of small language models (SLMs) trained from scratch
specifically for JavaScript-ecosystem code generation. They are built and distributed by
**AI LocalQmod** for use with [AI-App Builder](https://ai-localqmod.com), a local-first
AI app generation tool, but the GGUF files are plain [llama.cpp](https://github.com/ggerganov/llama.cpp)
models and can be loaded with any GGUF-compatible runtime (llama.cpp, llama-cpp-python,
Ollama with a Modelfile, LM Studio, etc.).
Unlike general-purpose LLMs, each model here is trained on a narrow, single-purpose corpus
(natural-language instruction → JS-family code) with a from-scratch tokenizer tuned for
that language's syntax and vocabulary. This trades general reasoning ability for
extremely small size and fast local inference, making them a good fit for lightweight,
single-purpose code-completion helpers rather than full coding assistants.
## Models
| File | Target | Quantization | Size |
|---|---|---|---|
| `js-slm-Q4_K_M-chat.gguf` | JavaScript | Q4_K_M | 17.7 MB |
| `jsts-slm-Q4_K_M-chat.gguf` | JavaScript + TypeScript | Q4_K_M | 17.5 MB |
| `node-slm-Q4_K_M-chat.gguf` | Node.js (fs/path/process/http/events) | Q4_K_M | 20.0 MB |
| `react-slm-Q4_K_M-chat.gguf` | React components | Q4_K_M | 16.6 MB |
| `js-loops-slm-Q4_K_M-chat.gguf` | JavaScript (for-loops + arrays: sum/max/count/filter/map/average) | Q4_K_M | 20.4 MB |
Sizes measured with `stat -f%z` (exact byte count), not rounded `ls -lh` output.
## Intended use
- Local, single-purpose code generation for the target language/framework shown above
- Multi-agent "orchestration" pipelines where a larger LLM plans and one of these SLMs
generates individual small functions/components
- Environments where downloading a multi-GB model is impractical (offline demos, low-disk
devices, quick experiments)
## Not intended for
- General-purpose chat or reasoning
- Large, multi-file refactors or architecture design
- Languages/frameworks outside each model's specific target (see table above)
## Usage (llama.cpp)
```bash
llama-cli -m js-slm-Q4_K_M-chat.gguf -p "Write a function that returns the sum of an array" -n 128
```
## Usage (llama-cpp-python)
```python
from llama_cpp import Llama
llm = Llama(model_path="js-slm-Q4_K_M-chat.gguf")
result = llm.create_chat_completion(
messages=[{"role": "user", "content": "Write a function that returns the sum of an array"}]
)
print(result["choices"][0]["message"]["content"])
```
## License
MIT. Free to use, modify, and redistribute.
## About AI LocalQmod
AI LocalQmod builds local-first, privacy-respecting AI tools. Learn more at
[ai-localqmod.com](https://ai-localqmod.com).
|