Package Insights
Package Risks
- No releases in 740 days despite active commits
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100Weekly Downloads
GitHub Stars
Downloads by OS
Python Versions
Top Countries
Dependencies
- cmake >=3.21
- fastapi
- ninja
- numpy
- outlines ==0.0.34
- prometheus-client >=0.18.0
- psutil
- py-cpuinfo
- pydantic >=2.0
- pynvml ==11.5.0
- ray >=2.9
- requests
- sentencepiece
- tiktoken ==0.6.0
- torch ==2.1.2
- transformers >=4.39.1
- triton >=2.1.0
- uvicorn
- vllm-nccl-cu12 <2.19,>=2.18
- xformers ==0.0.23.post1