fastapi
uvicorn
torch
transformers
datasets
peft

pynvml>=11.5.0