Text Generation
GGUF
English
Chinese
qwen3_5
qwen3.8
quantized
imatrix
iq3_s
iq4_xs
q3_k
q5_k
ssm-fix
conv1d-repair
llama.cpp
conversational
Instructions to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL # Run inference directly in the terminal: llama cli -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL # Run inference directly in the terminal: llama cli -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL # Run inference directly in the terminal: ./llama-cli -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL # Run inference directly in the terminal: ./build/bin/llama-cli -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Use Docker
docker model run hf.co/Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
- LM Studio
- Jan
- vLLM
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
- Ollama
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Ollama:
ollama run hf.co/Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
- Unsloth Desktop
- Pi
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Docker Model Runner:
docker model run hf.co/Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
- Lemonade
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Run and chat with the model
lemonade run user.Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF-UD-Q3_K_XL
List all available models
lemonade list
- Hermes Agent
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Luis23333/Qwen3.8-27B-SSMFIX-UD-Q3_K_XL-GGUF:UD-Q3_K_XL" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 7,294 Bytes
7f7354d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 | Apache License
Version 2.0, January 2004
http://www.apache.org/licenses/
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
1. Definitions.
"License" shall mean the terms and conditions for use, reproduction,
and distribution as defined by Sections 1 through 9 of this document.
"Licensor" shall mean the copyright owner or entity authorized by
the copyright owner that is granting the License.
"Legal Entity" shall mean the union of the acting entity and all
other entities that control, are controlled by, or are under common
control with that entity. For the purposes of this definition,
"control" means (i) the power, direct or indirect, to cause the
direction or management of such entity, whether by contract or
otherwise, or (ii) ownership of fifty percent (50%) or more of the
outstanding shares, or (iii) beneficial ownership.
"You" (or "Your") shall mean an individual or Legal Entity
exercising permissions granted by this License.
"Source" form shall mean the preferred form for making modifications,
including but not limited to software source code, documentation
source, and configuration files.
"Object" form shall mean any form resulting from mechanical
transformation or translation of a Source form, including but
not limited to compiled object code, generated documentation,
and conversions to other media types.
"Work" shall mean the work of authorship, whether in Source or
Object form, made available under the License, as indicated by a
copyright notice that is included in or attached to the work.
"Derivative Works" shall mean any work of authorship, whether in
Source or Object form, that is based on (or derived from) the Work
and for which the editorial revisions, annotations, elaborations,
or other modifications represent, as a whole, an original work of
authorship. Derivative Works shall not include works that remain
separable from, or merely link (or bind by name) to the interfaces
of, the Work and Derivative Works thereof.
"Contribution" shall mean any work of authorship, including
the original version of the Work and any modifications or additions
to that Work or Derivative Works thereof, that is intentionally
submitted to Licensor for inclusion in the Work by the copyright
owner or by an individual or Legal Entity authorized to submit on
behalf of the copyright owner.
"Contributor" shall mean Licensor and any individual or Legal Entity
on behalf of whom a Contribution has been received by Licensor and
subsequently incorporated within the Work.
2. Grant of Copyright License. Subject to the terms and conditions of
this License, each Contributor hereby grants to You a perpetual,
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
copyright license to reproduce, prepare Derivative Works of,
publicly display, publicly perform, sublicense, and distribute the
Work and such Derivative Works in Source or Object form.
3. Grant of Patent License. Subject to the terms and conditions of
this License, each Contributor hereby grants to You a perpetual,
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
(except as stated in this section) patent license to make, have made,
use, offer to sell, sell, import, and otherwise transfer the Work,
where such license applies only to those patent claims licensable
by such Contributor that are necessarily infringed by their
Contribution(s) alone or by combination of their Contribution(s)
with the Work to which such Contribution(s) was submitted.
4. Redistribution. You may reproduce and distribute copies of the
Work or Derivative Works thereof in any medium, with or without
modifications, and in Source or Object form, provided that You meet
the following conditions:
(a) You must give any other recipients of the Work or Derivative
Works a copy of this License; and
(b) You must cause any modified files to carry prominent notices
stating that You changed the files; and
(c) You must retain, in the Source form of any Derivative Works that
You distribute, all copyright, patent, trademark, and attribution
notices from the Source form of the Work, excluding those notices
that do not pertain to any part of the Derivative Works; and
(d) If the Work includes a NOTICE text file as part of its
distribution, then any Derivative Works that You distribute must
include a readable copy of the attribution notices contained
within such NOTICE file, excluding those notices that do not
pertain to any part of the Derivative Works.
5. Submission of Contributions. Unless You explicitly state otherwise,
any Contribution intentionally submitted for inclusion in the Work
by You to the Licensor shall be under the terms and conditions of
this License, without any additional terms or conditions.
6. Trademarks. This License does not grant permission to use the trade
names, trademarks, service marks, or product names of the Licensor,
except as required for reasonable and customary use in describing
the origin of the Work.
7. Disclaimer of Warranty. Unless required by applicable law or agreed
to in writing, Licensor provides the Work on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
implied, including, without limitation, any warranties or conditions
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
PARTICULAR PURPOSE.
8. Limitation of Liability. In no event and under no legal theory,
whether in tort, contract, or otherwise, unless required by applicable
law, shall any Contributor be liable to You for damages arising from
the use of or inability to use the Work.
9. Accepting Warranty or Additional Liability. While redistributing
the Work or Derivative Works thereof, You may choose to offer, and
charge a fee for, acceptance of support, warranty, indemnity, or
other liability obligations and/or rights consistent with this
License. However, in accepting such obligations, You may act only on
Your own behalf and on Your sole responsibility.
END OF TERMS AND CONDITIONS
APPENDIX: How to apply the Apache License to your work.
Copyright 2026 Alibaba Cloud
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
|