---
license: apache-2.0
base_model:
- tencent/HunyuanOCR
library_name: transformers
language:
- en
- zh
pipeline_tag: image-text-to-text
tags:
- llama-cpp
- text-generation-inference
- ocr
- vision-language-model
- document-parsing
- text-spotting
- information-extraction
- text-image-translation
---

# **HunyuanOCR-1.5-GGUF-Updated**

> **[HunyuanOCR-1.5](https://huggingface.co/tencent/HunyuanOCR)** is Tencent's lightweight, end-to-end OCR-specialized vision-language model that unifies document parsing, text spotting, information extraction, and text-image translation within a single VLM, building on the validated architecture of HunyuanOCR-1.0 (archived under the `v1.0/` subfolder) without redesigning the backbone. Its key upgrades target speed and capability: a **DFlash speculative-decoding** framework uses a lightweight block-diffusion draft model to propose multiple candidate tokens in parallel, verified by the target model in a single pass, significantly cutting decoding latency on long structured outputs like dense documents, tables, and formulas while preserving the original output distribution; it also supports CPU/consumer-GPU/laptop deployment via a GGUF-converted checkpoint and OpenAI-compatible `llama-server`, including a DFlash-adapted llama.cpp fork. On the training side, an **Agentic Data Flow** system — where agents handle material search, tool-based verification, and data-pipeline iteration in a closed loop with engineers — targets long-tail capabilities like low-resource and ancient-script OCR, alongside an upgraded recipe extending maximum image resolution to 4K and context window to 128K tokens, with refined SFT data and reinforcement learning across OCR tasks. The model uses the `HunYuanVLForConditionalGeneration` architecture (requiring transformers ≥5.13.0), supports native transformers, vLLM (both AR and DFlash modes from a single unified `uv`-based CUDA 13 environment), and llama.cpp inference paths across 12 task types (document parsing, structured/layout parsing, chart/formula/table extraction, and Chinese-English translation variants), and is released under the Tencent Hunyuan Community License Agreement.

> [!NOTE]
> HunyuanOCR v1.5 [GGUF]

## Model Files

   File Name | Quant Type | File Size | File Link |
 |-----------|------------|-----------|-----------|
 | HunyuanOCR.BF16.gguf | BF16 | 1.08 GB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.BF16.gguf) |
 | HunyuanOCR.F16.gguf | F16 | 1.08 GB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.F16.gguf) |
 | HunyuanOCR.F32.gguf | F32 | 2.16 GB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.F32.gguf) |
 | HunyuanOCR.Q3_K_L.gguf | Q3_K_L | 327 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.Q3_K_L.gguf) |
 | HunyuanOCR.Q3_K_M.gguf | Q3_K_M | 308 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.Q3_K_M.gguf) |
 | HunyuanOCR.Q3_K_S.gguf | Q3_K_S | 285 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.Q3_K_S.gguf) |
 | HunyuanOCR.Q4_K_M.gguf | Q4_K_M | 355 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.Q4_K_M.gguf) |
 | HunyuanOCR.Q4_K_S.gguf | Q4_K_S | 342 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.Q4_K_S.gguf) |
 | HunyuanOCR.Q5_K_M.gguf | Q5_K_M | 400 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.Q5_K_M.gguf) |
 | HunyuanOCR.Q5_K_S.gguf | Q5_K_S | 392 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.Q5_K_S.gguf) |
 | HunyuanOCR.Q8_0.gguf | Q8_0 | 578 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.Q8_0.gguf) |
 | HunyuanOCR.mmproj-bf16.gguf | mmproj-bf16 | 997 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.mmproj-bf16.gguf) |
 | HunyuanOCR.mmproj-f16.gguf | mmproj-f16 | 997 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.mmproj-f16.gguf) |
 | HunyuanOCR.mmproj-q8_0.gguf | mmproj-q8_0 | 733 MB | [Download](https://huggingface.co/prithivMLmods/HunyuanOCR-1.5-GGUF-Updated/blob/main/HunyuanOCR.mmproj-q8_0.gguf) |

## llama.cpp

LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp