Search Packages

trafilatura

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

firecrawl-py

🔥 The API to search, scrape, and interact with the web for AI

firecrawl

🔥 The API to search, scrape, and interact with the web for AI

spider-client

Python, Javascript, and Rust libraries for the Spider Cloud API.

confluence-markdown-exporter

Export Atlassian Confluence pages as markdown files.

pyhtml2md

Transform your HTML into clean, easy-to-read markdown with html2md.

crw

Fast, lightweight Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/v1/scrape, /v1/crawl, /v1/search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

article-extractor

Pure-Python article extraction library and HTTP API - Extract clean content from web pages as Markdown or HTML

file2txt

file2txt is a Python library takes common file formats and turns them into plain text (a txt file) with Markdown styling.

markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

llm-data-converter

Best open-source document to markdown converter for LLM training data. Convert PDF, Word, PowerPoint, Excel, images, URLs to clean markdown, JSON, HTML locally. Alternative to Unstructured, Docling, Marker, MarkItDown, MinerU, PaddleOCR, Tesseract

markgrab

Universal web content extraction — URL to LLM-ready markdown

html2txt

Convert HTML to markdown

document-data-extractor

Convert any document format into LLM-ready data format (markdown) with advanced intelligent document processing capabilities powered by pre-trained models.

url2md4ai

Lean Python tool for extracting clean, LLM-optimized markdown from web pages. Handles dynamic content with Playwright + Trafilatura for maximum information extraction efficiency.

spiderwebai-py

Python, Javascript, and Rust libraries for the Spider Cloud API.

bookmarkdown

✅ Parse your browser's exported HTML bookmark file to Markdown.

spiderclient-py

Python, Javascript, and Rust libraries for the Spider Cloud API.

spidercloud-py

Python, Javascript, and Rust libraries for the Spider Cloud API.

bookmarks2markdown

Convert bookmarks to Markdown