---
license: other
license_name: modified-mit
library_name: transformers
pipeline_tag: image-text-to-text
base_model:
- moonshotai/Kimi-K2.7-Code
tags:
- unsloth
- compressed-tensors
- abliterated
- uncensored
- GGUF
- MXFP4
- huihui

extra_gated_prompt: >-
    **Usage Warnings**


    “**Risk of Sensitive or Controversial Outputs**“: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.

    “**Not Suitable for All Audiences**:“ Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.

    “**Legal and Ethical Responsibilities**“: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.

    “**Research and Experimental Use**“: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.

    “**Monitoring and Review Recommendations**“: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.

    “**No Default Safety Guarantees**“: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.


---

# huihui-ai/Huihui-Kimi-K2.7-Code-abliterated-GGUF

This is an uncensored version of [moonshotai/Kimi-K2.7-Code](https://huggingface.co/moonshotai/Kimi-K2.7-Code) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. 

**Note** We will directly perform ablation on the GGUF files from [unsloth/Kimi-K2.7-Code-GGUF](https://huggingface.co/unsloth/Kimi-K2.7-Code-GGUF). Some weights quantized in Q5_K and Q6_K will be converted to MXFP4. This time, the weights of layers <16 and >36 and all expert modules were not ablated.



## Download and merge 


Use the [llama.cpp](https://github.com/ggml-org/llama.cpp) split program to merge model (llama-gguf-split needs to be compiled.),

```
huggingface-cli download huihui-ai/Huihui-Kimi-K2.7-Code-abliterated-GGUF --local-dir ./huihui-ai/Huihui-Kimi-K2.7-Code-abliterated-GGUF --token xxx


llama-gguf-split --merge huihui-ai/Huihui-Kimi-K2.7-Code-abliterated-GGUF/UD-IQ1_M-MXFP4/Kimi-K2.7-Code-UD-IQ1_M-00001-of-00008.gguf huihui-ai/Huihui-Kimi-K2.7-Code-abliterated-GGUF/Kimi-K2.7-Code-UD-IQ1_M.gguf

```

## llama.cpp
Use the latest [llama.cpp](https://github.com/ggml-org/llama.cpp),
```
llama-cli -m huihui-ai/Huihui-Kimi-K2.7-Code-abliterated-GGUF/UD-IQ1_M-MXFP4/Kimi-K2.7-Code-UD-IQ1_M-00001-of-00008.gguf -c 262144 --chat-template-kwargs "{\"enable_thinking\":true, \"preserve_thinking\":true}" --reasoning-format deepseek --temp 1.0

```


### Usage Warnings


 - **Risk of Sensitive or Controversial Outputs**: This model’s safety filtering has been significantly reduced, potentially generating sensitive, controversial, or inappropriate content. Users should exercise caution and rigorously review generated outputs.

 - **Not Suitable for All Audiences**: Due to limited content filtering, the model’s outputs may be inappropriate for public settings, underage users, or applications requiring high security.

 - **Legal and Ethical Responsibilities**: Users must ensure their usage complies with local laws and ethical standards. Generated content may carry legal or ethical risks, and users are solely responsible for any consequences.

 - **Research and Experimental Use**: It is recommended to use this model for research, testing, or controlled environments, avoiding direct use in production or public-facing commercial applications.

 - **Monitoring and Review Recommendations**: Users are strongly advised to monitor model outputs in real-time and conduct manual reviews when necessary to prevent the dissemination of inappropriate content.

 - **No Default Safety Guarantees**: Unlike standard models, this model has not undergone rigorous safety optimization. huihui.ai bears no responsibility for any consequences arising from its use.


### Donation

If you like it, please click 'like' and follow us for more updates.  
You can follow [x.com/support_huihui](https://x.com/support_huihui) to get the latest model information from huihui.ai.

##### Your donation helps us continue our further development and improvement, a cup of coffee can do it.
- bitcoin（BTC):
```
  bc1qqnkhuchxw0zqjh2ku3lu4hq45hc6gy84uk70ge
```
- Support our work on Ko-fi (https://ko-fi.com/huihuiai)!