--- license: mit base_model: - moonshotai/Kimi-VL-A3B-Instruct pipeline_tag: image-text-to-text tags: - kimi-vl --- ## GGUFs for moonshotai/Kimi-VL-A3B-Instruct Didn't see any GGUFs for this model, which is a legit model, so baked a couple. Hopefully useful to someone. Just straight llama-quantize off a BF16 convert_hf_to_gguf.py run. Sanity checked. - Base model: [moonshotai/Kimi-VL-A3B-Instruct](https://huggingface.co/moonshotai/Kimi-VL-A3B-Instruct "moonshotai/Kimi-VL-A3B-Instruct") - GGUFs for Thinking version: [ssweens/Kimi-VL-A3B-Thinking-2506-GGUF](https://huggingface.co/ssweens/Kimi-VL-A3B-Thinking-2506-GGUF "ssweens/Kimi-VL-A3B-Thinking-2506-GGUF")