gradio
huggingface_hub
transformers>=4.40.0
torch
accelerate
gguf
pydantic==2.10.6