A newer version of the Gradio SDK is available: 6.22.0
metadata
title: Distilled MoE Draft Demo
emoji: 🚀
colorFrom: blue
colorTo: purple
sdk: gradio
sdk_version: 4.31.0
app_file: app.py
pinned: false
license: apache-2.0
Distilled MoE Draft for Speculative Decoding
Compare text generation between distilled draft models and base models.
Models
- Dense Distilled Draft: bharadwajvyadavalli/qwen2.5-distilled-draft-fast
- MoE Draft (4 experts): bharadwajvyadavalli/qwen2.5-moe-draft-4experts-fast