File size: 706 Bytes
13c2337 3524137 13c2337 3524137 13c2337 b7d33fc 13c2337 3524137 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 | ---
title: Distilled MoE Draft Demo
emoji: 🚀
colorFrom: blue
colorTo: purple
sdk: gradio
sdk_version: 4.31.0
app_file: app.py
pinned: false
license: apache-2.0
---
# Distilled MoE Draft for Speculative Decoding
Compare text generation between distilled draft models and base models.
## Models
- **Dense Distilled Draft**: [bharadwajvyadavalli/qwen2.5-distilled-draft-fast](https://huggingface.co/bharadwajvyadavalli/qwen2.5-distilled-draft-fast)
- **MoE Draft (4 experts)**: [bharadwajvyadavalli/qwen2.5-moe-draft-4experts-fast](https://huggingface.co/bharadwajvyadavalli/qwen2.5-moe-draft-4experts-fast)
## Links
- [GitHub Repository](https://github.com/bharadwajvyadavalli/distilled-moe-drafts)
|