PyPI Stats
gweidart

rs-bpe

A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust
PyPI GitHub
Downloads
Day
1.2K
Week
5.3K
Month
23.8K
Stars
38
Forks
5
Issues
3
Version
0.1.0

Package Insights

What's this?
Score breakdown - each component scores 0–100, weighted by percentage
Maintenance
0
Popularity
30
Adoption
53
Community
10
How the maintenance status was determined
Last commit
413 days ago
Monthly downloads
23,811
Active
Activity within 30 days
Stable
Activity within 31-180 days
Minimal
Activity within 181-365 days, or no activity data
• At Risk
No activity for > 365 days, but > 10,000 monthly downloads
Archived
Repository flagged as archived on GitHub
How the popularity category was determined
Monthly downloads
23,811
Stars
38
Stars per 1k downloads
1.60
Industry Standard
> 10,000,000 monthly downloads
Hidden Gem
< 0.5 stars per 1k downloads and > 100,000 monthly downloads
Community Favorite
> 5 stars per 1k downloads
• Rising Star
Balanced ratio of stars to downloads
Unknown
Fewer than 1,000 monthly downloads, or no star data
How download momentum is calculated
Week daily avg
757
Month daily avg
794
Momentum
-4.6%
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100
Python version support tiers
requires_python
>=3.8
Cutting Edge
Minimum supported version is 3.12 or newer
Modern
Minimum supported version is 3.9, 3.10, or 3.11
• Legacy
Supports 3.8 or older (or Python 2)
Unknown
No requires_python specified or unparseable
License categories
License
MIT
• Permissive
MIT, Apache, BSD, ISC, Unlicense, CC0, etc.
Copyleft
GPL, LGPL, AGPL, MPL, EPL, etc.
Proprietary
Commercial, all rights reserved, custom EULAs
Unknown
No license specified, or none of the above match
How the release cadence was determined
Last release
413 days ago
Total releases
1
Releases/year
0.9
Rapid
Last release within 365 days and > 12 releases/year
Regular
Last release within 365 days
• Slow
Last release 366-730 days ago
Stalled
Last release > 730 days ago, or no releases
Unknown
No usable release date available
How contributor risk was determined
Contributors
2
Monthly downloads
23,811
High Load
≤ 2 contributors and ≥ 50,000 monthly downloads
Moderate Load
< 10 contributors and ≥ 500,000 monthly downloads
Low Load
< 25 contributors and ≥ 5,000,000 monthly downloads, or sole maintainer with ≥ 10,000 monthly downloads
• Balanced
Enough contributors for the package's popularity
Unknown
No contributor data available
Engagement
21
 
Issue Burden
-
per 1k stars
Discussions
-
per 1k stars
Fork Ratio
40.0%
contrib / forks
Stale Release
No
 
PR Velocity
Quiet
 

Weekly Downloads

GitHub Stars

Not all downloads include detailed metadata. Breakdowns reflect the subset that does.

Downloads by OS

Linux 232

Python Versions

3.11
100.0% 226

Top Countries

1. US US
231
2. IN IN
2
3. CA CA
1

Dependencies

0
10 optional dependencies

Used By

1

Package Information

License
MIT
First Release
March 19, 2025
Last Release
1 year ago
Last Commit
1 year ago
Latest Version
0.1.0
Total Releases
1
Contributors
2
Open PRs
0
Archived
No
Author
gweidart <gweidart@gmail.com>
Python Versions
3 3.8 3.9 3.10 3.11 3.12 3.13
Wheels
cp311
Keywords
byte-pair-encoding subword-tokenization subword-units tokenization tokenizer vocabulary vocab text-encoding text-processing string-encoding rust rust-extension cpython-extension python-library python-package pypi cross-platform fast performance high-performance efficient optimized speed blazing-fast rapid accelerated nlp natural-language-processing machine-learning deep-learning artificial-intelligence ai
Topics
bpe bpe-tokenizer byte-pair-encoding byte-pair-tokenizer huggingface llm openai pypi-package python rust tiktoken tokenizers
Tracking Since
January 6, 2026
Data Updated
May 3, 2026
Data Freshness
Fresh

Links