Text Extraction Python Packages

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

justext

Heuristic based boilerplate removal tool

srt

A simple library and set of tools for parsing, modifying, and composing SRT files.

html-to-markdown

High performance and CommonMark compliant HTML to Markdown converter. Maintained by the Kreuzberg team. Kreuzberg is a fast, polyglot document intelligence engine with a Rust core. It extracts structured data from 56+ document formats using streaming parsers and built-in OCR.

tika

Tika-Python is a Python binding to the Apache Tika™ REST services allowing Tika to be called natively in the Python community.

boilerpy3

Python port of Boilerpipe library

kreuzberg

A polyglot document intelligence framework with a Rust core. Extract text, metadata, images, and structured information from PDFs, Office documents, images, and 97+ formats. Available for Rust, Python, Ruby, Java, Go, PHP, Elixir, C#, R, C, TypeScript (Node/Bun/Wasm/Deno)- or use via CLI, REST API, or MCP server.

sumy

Module for automatic summarization of text documents and HTML pages.

breadability

Reworked https://www.readability.com/ parsing library (now https://mercury.postlight.com/ is living alternative)

pdf-oxide

The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.

python-hwpx

Pure Python HWPX automation: read, edit, generate, and validate documents without Hancom Office.

mobi

python based software to unpack kindlegen generated ebooks

liteparse

A fast, helpful, and open-source document parser

bolivar

High-performance PDF table extraction library. Bindings for Python and JVM.

galeodes

Browsers options

fundus

A very simple news crawler with a funny name

preocr

Fast document classification and OCR detection. Analyzes any file type to determine if OCR is needed, saving time and money on unnecessary processing.

reap-pdf

Rust-first PDF text extraction with geometry-aware search and optional Python bindings

aiopytesseract

A Python asyncio wrapper for Tesseract-OCR.

vision-parse

Parse PDF documents into markdown formatted content using Vision LLMs

pattex

Regex-based pattern extraction library for Python — emails, URLs, phones, IPs, and more.

yirabot

YiraBot: Simplifying Web Scraping for All. A user-friendly tool for developers and enthusiasts, offering command-line ease and Python integration. Ideal for research, SEO, and data collection.

maalfrid-toolkit

Toolkit for the Målfrid project

pnlp

NLP预/后处理工具。