fastapi
uvicorn[standard]
transformers
peft
torch
accelerate
bitsandbytes
sentencepiece
huggingface_hub
protobuf