ai-lqm commited on
Commit
c79b7b8
·
verified ·
1 Parent(s): 74756c3

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +86 -0
README.md ADDED
@@ -0,0 +1,86 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ - ja
6
+ tags:
7
+ - gguf
8
+ - llama.cpp
9
+ - code-generation
10
+ - javascript
11
+ - typescript
12
+ - react
13
+ - nodejs
14
+ - slm
15
+ pipeline_tag: text-generation
16
+ ---
17
+
18
+ # AI LocalQmod — JS-family Code SLMs (GGUF)
19
+
20
+ **Ultra-small, single-purpose code-generation models — as light as ~17 MB.**
21
+
22
+ This repository hosts a family of small language models (SLMs) trained from scratch
23
+ specifically for JavaScript-ecosystem code generation. They are built and distributed by
24
+ **AI LocalQmod** for use with [AI-App Builder](https://ai-localqmod.com), a local-first
25
+ AI app generation tool, but the GGUF files are plain [llama.cpp](https://github.com/ggerganov/llama.cpp)
26
+ models and can be loaded with any GGUF-compatible runtime (llama.cpp, llama-cpp-python,
27
+ Ollama with a Modelfile, LM Studio, etc.).
28
+
29
+ Unlike general-purpose LLMs, each model here is trained on a narrow, single-purpose corpus
30
+ (natural-language instruction → JS-family code) with a from-scratch tokenizer tuned for
31
+ that language's syntax and vocabulary. This trades general reasoning ability for
32
+ extremely small size and fast local inference, making them a good fit for lightweight,
33
+ single-purpose code-completion helpers rather than full coding assistants.
34
+
35
+ ## Models
36
+
37
+ | File | Target | Quantization | Size |
38
+ |---|---|---|---|
39
+ | `js-slm-Q4_K_M-chat.gguf` | JavaScript | Q4_K_M | 17.7 MB |
40
+ | `jsts-slm-Q4_K_M-chat.gguf` | JavaScript + TypeScript | Q4_K_M | 17.5 MB |
41
+ | `node-slm-Q4_K_M-chat.gguf` | Node.js (fs/path/process/http/events) | Q4_K_M | 20.0 MB |
42
+ | `react-slm-Q4_K_M-chat.gguf` | React components | Q4_K_M | 16.6 MB |
43
+ | `js-loops-slm-Q4_K_M-chat.gguf` | JavaScript (for-loops + arrays: sum/max/count/filter/map/average) | Q4_K_M | 20.4 MB |
44
+
45
+ Sizes measured with `stat -f%z` (exact byte count), not rounded `ls -lh` output.
46
+
47
+ ## Intended use
48
+
49
+ - Local, single-purpose code generation for the target language/framework shown above
50
+ - Multi-agent "orchestration" pipelines where a larger LLM plans and one of these SLMs
51
+ generates individual small functions/components
52
+ - Environments where downloading a multi-GB model is impractical (offline demos, low-disk
53
+ devices, quick experiments)
54
+
55
+ ## Not intended for
56
+
57
+ - General-purpose chat or reasoning
58
+ - Large, multi-file refactors or architecture design
59
+ - Languages/frameworks outside each model's specific target (see table above)
60
+
61
+ ## Usage (llama.cpp)
62
+
63
+ ```bash
64
+ llama-cli -m js-slm-Q4_K_M-chat.gguf -p "Write a function that returns the sum of an array" -n 128
65
+ ```
66
+
67
+ ## Usage (llama-cpp-python)
68
+
69
+ ```python
70
+ from llama_cpp import Llama
71
+
72
+ llm = Llama(model_path="js-slm-Q4_K_M-chat.gguf")
73
+ result = llm.create_chat_completion(
74
+ messages=[{"role": "user", "content": "Write a function that returns the sum of an array"}]
75
+ )
76
+ print(result["choices"][0]["message"]["content"])
77
+ ```
78
+
79
+ ## License
80
+
81
+ MIT. Free to use, modify, and redistribute.
82
+
83
+ ## About AI LocalQmod
84
+
85
+ AI LocalQmod builds local-first, privacy-respecting AI tools. Learn more at
86
+ [ai-localqmod.com](https://ai-localqmod.com).