PyPI Stats
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About
Home

Search Packages

Find Python packages by name, description, GitHub topic, or filter by metrics
myint
untokenize

Transforms tokens into original source code (while preserving whitespace)

688K 9 3
OpenVoiceOS
quebra-frases

chunks strings into byte sized pieces

13K 1 3
TI-Toolkit
tivars

A Python library for interacting with TI-(e)z80 (82/83/84 series) calculator files

2K 26 1
alasdairforsythe
tokenmonster

Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript

2K 623 21
lensvol
tokelor

Visualize Python token stream produced by tokenize module.

884 1 0
sina-al
pynlp

A pythonic wrapper for Stanford CoreNLP.

620 107 11
poyo46
jadoc

Tokenizes Japanese documents to enable CRUD operations.

369 0 0
akb89
witokit

A Python toolkit to generate a tokenized dump of Wikipedia for NLP

326 11 1
carlosplanchon
tokenizesentences

Python module to tokenize english sentences.

203 6 1
    • Data from PyPI, GitHub, ClickHouse, and BigQuery