---
title: Distilled MoE Draft Demo
emoji: 🚀
colorFrom: blue
colorTo: purple
sdk: gradio
sdk_version: 4.31.0
app_file: app.py
pinned: false
license: apache-2.0
---

# Distilled MoE Draft for Speculative Decoding

Compare text generation between distilled draft models and base models.

## Models

- **Dense Distilled Draft**: [bharadwajvyadavalli/qwen2.5-distilled-draft-fast](https://huggingface.co/bharadwajvyadavalli/qwen2.5-distilled-draft-fast)
- **MoE Draft (4 experts)**: [bharadwajvyadavalli/qwen2.5-moe-draft-4experts-fast](https://huggingface.co/bharadwajvyadavalli/qwen2.5-moe-draft-4experts-fast)

## Links

- [GitHub Repository](https://github.com/bharadwajvyadavalli/distilled-moe-drafts)