--- language: [en, zh, ja, ko, es, ru] library_name: gguf tags: - gguf - q4_k_s - quantized - qwen - qwopus base_model: Jackrong/Qwopus3.6-27B-v2 license: apache-2.0 --- # Qwopus3.6-27B-v2 Q4_K_S GGUF Q4_K_S quantization of [`Jackrong/Qwopus3.6-27B-v2`](https://huggingface.co/Jackrong/Qwopus3.6-27B-v2) via stock `llama.cpp` (ggml-org/llama.cpp), built on Apple Silicon with Metal support. Preserves MTP draft heads. ## Use ```bash llama-cli -m Qwopus3.6-27B-v2-Q4_K_S.gguf -p "Hi" ``` Author's temperature recommendation: 0.75–1.0. ## Credits - Source: [`Jackrong/Qwopus3.6-27B-v2`](https://huggingface.co/Jackrong/Qwopus3.6-27B-v2) by Jackrong - GGUF conversion by [zaydiscold](https://huggingface.co/zaydiscold) --- *Mix brought by the NOTORIOUS MLX.*