PyPI Stats
xorbitsai

xinference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
PyPI GitHub
Downloads
Day
1.6K
Week
6.1K
Month
42.6K
Stars
9.3K
Forks
824
Issues
23
Version
2.7.0

Package Insights

What's this?
Score breakdown - each component scores 0–100, weighted by percentage
Maintenance
100
Popularity
84
Adoption
46
Community
70
How the maintenance status was determined
Last commit
6 days ago
Monthly downloads
42,584
• Active
Activity within 30 days
Stable
Activity within 31-180 days
Minimal
Activity within 181-365 days, or no activity data
At Risk
No activity for > 365 days, but > 10,000 monthly downloads
Archived
Repository flagged as archived on GitHub
How the popularity category was determined
Monthly downloads
42,584
Stars
9,281
Stars per 1k downloads
217.95
Industry Standard
> 10,000,000 monthly downloads
Hidden Gem
< 0.5 stars per 1k downloads and > 100,000 monthly downloads
• Community Favorite
> 5 stars per 1k downloads
Rising Star
Balanced ratio of stars to downloads
Unknown
Fewer than 1,000 monthly downloads, or no star data
How download momentum is calculated
Week daily avg
877
Month daily avg
1,419
Momentum
-38.2%
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100
Python version support tiers
requires_python
Not specified
Cutting Edge
Minimum supported version is 3.12 or newer
Modern
Minimum supported version is 3.9, 3.10, or 3.11
Legacy
Supports 3.8 or older (or Python 2)
• Unknown
No requires_python specified or unparseable
Package does not declare a minimum Python version.
License categories
License
Apache License 2.0
• Permissive
MIT, Apache, BSD, ISC, Unlicense, CC0, etc.
Copyleft
GPL, LGPL, AGPL, MPL, EPL, etc.
Proprietary
Commercial, all rights reserved, custom EULAs
Unknown
No license specified, or none of the above match
How the release cadence was determined
Last release
11 days ago
Total releases
142
Releases/year
50.1
• Rapid
Last release within 365 days and > 12 releases/year
Regular
Last release within 365 days
Slow
Last release 366-730 days ago
Stalled
Last release > 730 days ago, or no releases
Unknown
No usable release date available
How contributor risk was determined
Contributors
142
Monthly downloads
42,584
High Load
≤ 2 contributors and ≥ 50,000 monthly downloads
Moderate Load
< 10 contributors and ≥ 500,000 monthly downloads
Low Load
< 25 contributors and ≥ 5,000,000 monthly downloads, or sole maintainer with ≥ 10,000 monthly downloads
• Balanced
Enough contributors for the package's popularity
Unknown
No contributor data available
Engagement
63
 
Issue Burden
2.5
per 1k stars
Discussions
0.0
per 1k stars
Fork Ratio
17.2%
contrib / forks
Stale Release
No
 
PR Velocity
Quiet
 

Weekly Downloads

GitHub Stars

Not all downloads include detailed metadata. Breakdowns reflect the subset that does.

Downloads by OS

Linux 364
macOS 177
Windows 58

Python Versions

3.10
34.0% 200
3.11
29.6% 174
3.13
22.8% 134
3.12
12.4% 73
3.8
1.2% 7

Top Countries

1. TW TW
225
2. CN CN
134
3. JP JP
94
4. HK HK
75
5. US US
74
6. SG SG
7
7. RU RU
4
8. EE EE
2
9. PK PK
2
10. CA CA
1

Dependencies

27
242 optional dependencies

Used By

0
Not used by any tracked packages

Package Information

License
Apache License 2.0
First Release
July 7, 2023
Last Release
1 week ago
Last Commit
6 days ago
Latest Version
2.7.0
Total Releases
142
Contributors
142
Open PRs
25
Archived
No
Python Versions
3 3.10 3.11 3.12 3.13
Wheels
py3
Topics
ggml pytorch chatglm deployment flan-t5 llm wizardlm artificial-intelligence machine-learning whisper inference openai-api mistral gemma llama llamacpp vllm qwen llama3 glm4
Tracking Since
January 6, 2026
Data Updated
May 3, 2026
Data Freshness
Fresh

Links