PyPI Stats
bentoml

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
PyPI GitHub

Shared Repository

This package shares its GitHub repository (bentoml/OpenLLM) with 2 other packages. Stars, forks, and other GitHub metrics reflect the entire repository.
Downloads
Day
191
Week
1.3K
Month
17.5K
Stars
12.3K
Forks
807
Issues
4
Version
0.6.30

Package Insights

What's this?
Score breakdown - each component scores 0–100, weighted by percentage
Maintenance
50
Popularity
86
Adoption
42
Community
45
How the maintenance status was determined
Last commit
239 days ago
Monthly downloads
17,515
Active
Activity within 30 days
Stable
Activity within 31-180 days
• Minimal
Activity within 181-365 days, or no activity data
At Risk
No activity for > 365 days, but > 10,000 monthly downloads
Archived
Repository flagged as archived on GitHub
How the popularity category was determined
Monthly downloads
17,515
Stars
12,309
Stars per 1k downloads
702.77
Industry Standard
> 10,000,000 monthly downloads
Hidden Gem
< 0.5 stars per 1k downloads and > 100,000 monthly downloads
• Community Favorite
> 5 stars per 1k downloads
Rising Star
Balanced ratio of stars to downloads
Unknown
Fewer than 1,000 monthly downloads, or no star data
How download momentum is calculated
Week daily avg
188
Month daily avg
584
Momentum
-67.9%
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100
Python version support tiers
requires_python
>=3.9
Cutting Edge
Minimum supported version is 3.12 or newer
• Modern
Minimum supported version is 3.9, 3.10, or 3.11
Legacy
Supports 3.8 or older (or Python 2)
Unknown
No requires_python specified or unparseable
License categories
License
Apache-2.0
• Permissive
MIT, Apache, BSD, ISC, Unlicense, CC0, etc.
Copyleft
GPL, LGPL, AGPL, MPL, EPL, etc.
Proprietary
Commercial, all rights reserved, custom EULAs
Unknown
No license specified, or none of the above match
How the release cadence was determined
Last release
380 days ago
Total releases
195
Releases/year
66.2
Rapid
Last release within 365 days and > 12 releases/year
Regular
Last release within 365 days
• Slow
Last release 366-730 days ago
Stalled
Last release > 730 days ago, or no releases
Unknown
No usable release date available
How contributor risk was determined
Contributors
29
Monthly downloads
17,515
High Load
≤ 2 contributors and ≥ 50,000 monthly downloads
Moderate Load
< 10 contributors and ≥ 500,000 monthly downloads
Low Load
< 25 contributors and ≥ 5,000,000 monthly downloads, or sole maintainer with ≥ 10,000 monthly downloads
• Balanced
Enough contributors for the package's popularity
Unknown
No contributor data available
Engagement
67
 
Issue Burden
0.3
per 1k stars
Discussions
3.5
per 1k stars
Fork Ratio
3.6%
contrib / forks
Stale Release
141d
 
PR Velocity
Quiet
 

Weekly Downloads

GitHub Stars

Not all downloads include detailed metadata. Breakdowns reflect the subset that does.

Downloads by OS

Linux 90
Windows 8

Python Versions

3.10
73.5% 72
3.12
10.2% 10
3.11
8.2% 8
3.13
8.2% 8

Top Countries

1. US US
119
2. MY MY
8
3. IN IN
4
4. AU AU
2
5. CN CN
2
6. EE EE
2
7. KR KR
2
8. CA CA
1

Package Information

License
Apache-2.0
First Release
May 26, 2023
Last Release
1 year ago
Last Commit
7 months ago
Latest Version
0.6.30
Total Releases
195
Contributors
29
Open PRs
8
Archived
No
Python Versions
3 3.8 3.9 3.10 3.11 3.12
Wheels
py3
Keywords
AI Alpaca BentoML Falcon Fine tuning Generative AI LLMOps Large Language Model Llama 2 MLOps Mistral Model Deployment Model Serving PyTorch Serverless StableLM Transformers Vicuna vLLM
Topics
llm llmops model-inference fine-tuning llm-serving llama vicuna bentoml llama2 llm-inference llm-ops open-source-llm openllm mistral mlops llama3-1 llama3-2 llama3-2-vision
Tracking Since
January 6, 2026
Data Updated
May 3, 2026
Data Freshness
Fresh

Links