Data Extraction Python Packages

firecrawl-py

🔥 The API to search, scrape, and interact with the web for AI

flashtext

Extract Keywords from sentence or Replace keywords in sentences.

firecrawl

🔥 The API to search, scrape, and interact with the web for AI

vnstock

A beginner-friendly yet powerful Python toolkit for financial analysis and automation — built to make modern investing accessible to everyone

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

scrapfly-sdk

Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.

pdf-oxide

The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.

recipe-scrapers

Python package for scraping recipes data

amazoncaptcha

Pure Python, lightweight, Pillow-based solver for Amazon's text captcha.

stealth-requests

Undetected web-scraping & seamless HTML parsing in Python!

jsonpath-extractor

A query expression for extracting data from JSON.

contextgem

ContextGem: Effortless LLM extraction from documents

markcrawl

Fast Python web crawler for RAG and AI ingestion. Extracts clean Markdown from any site for LLMs and vector stores.

cyac

High performance Trie and Ahocorasick automata (AC automata) Keyword Match & Replace Tool for python. Correct case insensitive implementation!

vnstock3

A beginner-friendly yet powerful Python toolkit for financial analysis and automation — built to make modern investing accessible to everyone

optimuspyspark

:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark

scaledp

ScaleDP is an Open-Source extension of Apache Spark for Document Processing

hext

A module and command-line utility to extract structured data from HTML

scrape-cli

Extract HTML elements from the command line using CSS selectors or XPath. Pipe-friendly Python CLI.

crw

Fast, lightweight Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/v1/scrape, /v1/crawl, /v1/search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

wiktionary-de-parser

Extracts data from German Wiktionary dump files.

ytfetcher

⚡ Build structured YouTube datasets at scale — effortlessly fetch transcripts and rich metadata for NLP, ML, and AI workflows.

scout-intel-mcp

The Google for AI agents — ask Claude to research any company, analyze competitors, track market trends, and score data quality. 6 intelligence tools, 5+ data sources (DuckDuckGo, NewsAPI, Wikipedia, web scraping), confidence-scored structured JSON. pip install scout-intel-mcp

taprun

Automate any website. AI compiles it. Runs forever at $0. 200+ skills, 3 runtimes, MCP native.