---
license: llama3.2
base_model:
- huihui-ai/Llama-3.2-3B-Instruct-abliterated
---
Quantize the model from https://huggingface.co/huihui-ai/Llama-3.2-3B-Instruct-abliterated using the SpinQuant quantization method from https://github.com/facebookresearch/SpinQuant for on-device deployment in an Android app with Executorch.

2025-02-16 19:40:24,099 - spinquant - INFO - wiki2 ppl is: 11.502239227294922