Instructions to use mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M # Run inference directly in the terminal: llama cli -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M # Run inference directly in the terminal: llama cli -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M # Run inference directly in the terminal: ./llama-cli -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
Use Docker
docker model run hf.co/mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
- LM Studio
- Jan
- Ollama
How to use mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf with Ollama:
ollama run hf.co/mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
- Unsloth Desktop
- Pi
How to use mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf with Docker Model Runner:
docker model run hf.co/mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
- Lemonade
How to use mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
Run and chat with the model
lemonade run user.Kimi-K3-REAP50-Width50-UD-gguf-UD-IQ1_M
List all available models
lemonade list
- Hermes Agent
How to use mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "mmnga-o/Kimi-K3-REAP50-Width50-UD-gguf:UD-IQ1_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
| Kimi K3 License | |
| Copyright (c) 2026 Moonshot AI | |
| Permission is hereby granted, free of charge, to any person (the "Licensee") | |
| obtaining a copy of this software — including the model weights, parameters, | |
| configuration files, inference and training code, and associated documentation | |
| (collectively, the "Software") — to deal in the Software without restriction. | |
| This includes, without limitation, the rights to use, copy, modify, merge, | |
| publish, distribute, sublicense, and/or sell copies of the Software; to run, | |
| deploy, fine-tune, or otherwise modify the Software and create derivative works | |
| from it; and to permit persons to whom the Software is furnished to do so, in | |
| each case subject to the following conditions: | |
| 1. The above copyright notice and this permission notice shall be included in | |
| all copies or substantial portions of the Software. Licensee's use of the | |
| Software must comply with applicable laws and regulations. | |
| 2. "Model as a Service" means giving a third party access to language model | |
| inference or fine-tuning (e.g., via API) in a manner that allows such third | |
| party to exercise meaningful control over the inputs, parameters, or training | |
| data. This does not include (a) end-user products with model capabilities solely | |
| embedded within specific features or harnesses, or (b) mere relaying of requests | |
| to models hosted by others. | |
| If the Licensee or any of its affiliates operates a Model as a Service business, | |
| and the aggregate revenue of the Licensee and its affiliates exceeds 20 million | |
| US dollars (or the equivalent in other currencies) in total over any consecutive | |
| 12 months, the Licensee must enter into a separate agreement with Moonshot AI | |
| before using the Software or its derivative works for any commercial purpose. | |
| 3. If the Software (or any derivative works thereof) is used for any of the | |
| Licensee's commercial products or services that have more than 100 million | |
| monthly active users, or more than 20 million US dollars (or equivalent in other | |
| currencies) in monthly revenue, "Kimi K3" must be prominently displayed on the | |
| user interface of such product or service. | |
| 4. The requirements set forth in Sections 2 and 3 do not apply to: (a) internal | |
| use of the Software, defined as any use that does not make the Software, its | |
| outputs, or its underlying capabilities available to third parties; or (b) any | |
| use of the Software accessed through Moonshot AI's official products or | |
| certified inference partners. | |
| 5. THE SOFTWARE AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” | |
| BASIS, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT | |
| LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE | |
| AND NONINFRINGEMENT. IN NO EVENT SHALL MOONSHOT AI OR ITS AFFILIATES OR | |
| COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER | |
| IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN | |
| CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. | |
| For any questions regarding this license, please contact <license@moonshot.ai>. |