PyPI Stats
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About
Home

Search Packages

Find Python packages by name, description, GitHub topic, or filter by metrics
gweidart
rs-bpe

A ridiculously fast Python BPE (Byte Pair Encoder) implementation written in Rust

24K 38 5
akhvorov
vgram

V-gram builder library

484 7 0
crodriguez1a
bpe-summarizer

Auto summarization from BPE tokenization

331 3 1
DVDAGames
pgn-tokenizer

A byte pair encoding (BPE) tokenizer for chess portable game notation (PGN)

248 0 0
jiauzhang
textok

Text Tokenizer in C++

30 0 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery