Search Packages

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

article-parser

Extract article or news by url or html, parse the title and content, output in markdown format.

mineru-html

MinerU-HTML: An SLM-powered HTML main content extractor that outputs clean HTML bodies. Perfect for Deep Research Agents, RAG applications, and training data generation.

markdown-tool

Parse markdown article, download images and replace images URL's with local paths

llmparser

Turn any website into clean, structured content that language models can actually read.

arachnio

Client library for interacting with Arachnio API

newshound

This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around the world in over 50 languages.