---
license: other
license_name: tencent-hunyuan-community
license_link: https://huggingface.co/tencent/HunyuanOCR/blob/main/LICENSE
language:
- multilingual
pipeline_tag: image-text-to-text
library_name: llama.cpp
tags:
- ocr
- hunyuan
- vision-language
- image-to-text
- 1B
- gguf
- llama.cpp
base_model: tencent/HunyuanOCR
---

# HunyuanOCR GGUF

HunyuanOCR converted to **GGUF** format for inference with [llama.cpp](https://github.com/ggml-org/llama.cpp).

This is a quantization of [Tencent's HunyuanOCR](https://huggingface.co/tencent/HunyuanOCR) — a 1B parameter OCR expert Vision-Language Model. Native support was added in llama.cpp build `b8670` (April 2026).

## Model Architecture

| Component | Spec |
|-----------|------|
| Type | Vision-Language Model (VLM) |
| Parameters | ~1.12B |
| Text Model | hunyuan-dense, 24-layer decoder, 1024 dim, GQA (16Q/8KV) |
| Vision Encoder | 27-layer ViT, 1152 dim, perceiver-based projector |
| Features | xdrope RoPE, QK normalization, RMS norm, SiLU SwiGLU |

## Files

| File | Size | Description |
|------|------|-------------|
| `HunyuanOCR-Q4_K_M.gguf` | 339 MB | Text model — Q4_K_M quantized |
| `HunyuanOCR-Q8_0.gguf` | 551 MB | Text model — Q8_0 quantized |
| `HunyuanOCR-F16.gguf` | 1.0 GB | Text model — F16 (full precision) |
| `mmproj-HunyuanOCR-F16.gguf` | 909 MB | Vision encoder (mmproj) — F16 required |

## Usage

```bash
# Via Hugging Face (easiest)
llama-server -hf AnandSingh/hunyuanocr-GGUF

# Or locally
llama-server \
  -m HunyuanOCR-Q4_K_M.gguf \
  --mmproj mmproj-HunyuanOCR-F16.gguf
```

**API request:**
```json
{
  "messages": [
    {
      "role": "user",
      "content": [
        { "type": "text", "text": "OCR" },
        { "type": "image_url", "image_url": { "url": "data:image/jpeg;base64,..." } }
      ]
    }
  ]
}
```

## Prompt Examples

| Task | Prompt |
|------|--------|
| Text Spotting | `检测并识别图片中的文字，将文本坐标格式化输出。` |
| Document Parsing | `提取文档图片中正文的所有信息用markdown格式表示，其中页眉、页脚部分忽略，表格用html格式表达，文档中公式用latex格式表示，按照阅读顺序组织进行解析。` |
| Formula Recognition | `识别图片中的公式，用LaTeX格式表示。` |
| Table Extraction | `把图中的表格解析为 HTML。` |
| Translation | `先提取文字，再将文字内容翻译为英文。` |

## Requirements

- llama.cpp build `b8670` or later
- macOS, Linux, or Windows

## License

Licensed under the [Tencent Hunyuan Community License Agreement](https://huggingface.co/tencent/HunyuanOCR/blob/main/LICENSE).

## Attribution

Original model by [Tencent Hunyuan Vision Team](https://github.com/Tencent-Hunyuan/HunyuanOCR). GGUF conversion is not affiliated with or endorsed by Tencent.