Search Packages

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

textlasso

TextLasso is a Simple Python library for extracting structured data from raw text, with special focus on processing LLM (Large Language Model) responses.

harvesttext

No description available

squeakycleantext

Text preprocessing and PII anonymisation for NLP/ML. ONNX NER ensemble, language detection, stopword removal. Built for statistical ML and language models.

extractnet

Extract the main article content (and optionally comments) from a web page

pnlp

NLP预/后处理工具。

wisup-e2m

E2M converts various file types (doc, docx, epub, html, htm, url, pdf, ppt, pptx, mp3, m4a) into Markdown. It’s easy to install, with dedicated parsers and converters, supporting custom configs. E2M offers an all-in-one, flexible, and open-source solution.

valx

An open-source Python library for data cleaning tasks. Includes profanity detection, and removal. Now includes offensive language and hate speech detection using an AI model.

nlp-preprocessing

Text Preprocessing Package includes cleaning, tokenization, dataset preparation ...etc

topicrankpy

A Python package to get useful information from documents using TopicRank Algorithm.

textcl

Text preprocessing package for use in NLP tasks https://pypi.org/project/textcl/

mim-nlp

A Python package with ready-to-use models for various NLP tasks and text preprocessing utilities. The implementation allows fine-tuning.

rehuman

Python bindings for rehuman: Unicode-safe text cleaning & normalization

hnlp

NLP预/后处理工具。

takin

A Python toolkit for file processing, text cleaning and data splitting. 文件处理，文本清洗和数据划分的python工具包。

banglish-stopwords

A lightweight Python library to filter 350+ Banglish stopwords for NLP and text cleaning.

textprepro

Everything Everyway All At Once Text Preprocessing.

text-cleaner-yuvan

A simple text cleaning tool for NLP.

ternaus-cleantext

Clean text from extra spaces and special symbols as in the CLIP model.