---
license: apache-2.0
language:
- zho
- eng
- fra
- spa
- por
- deu
- ita
- rus
- jpn
- kor
- vie
- tha
- ara
base_model:
- Qwen/Qwen2.5-0.5B
pipeline_tag: text-generation
library_name: transformers
tags:
- qwen
- qwen2.5
- phi-4
- phi
---

# QwenPhi-4-0.5B-Draft

[Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct), but with the vocab of [microsoft/phi-4](https://huggingface.co/microsoft/phi-4) transplanted using [transplant-vocab](https://github.com/jukofyork/transplant-vocab).

Made from the instruct qwen to be used as a draft model for Phi-4 directly.

This Model was made based on the work of alamios at [alamios/Qwenstral-Small-3.1-0.5B](https://huggingface.co/alamios/Qwenstral-Small-3.1-0.5B)