Web Scraper Python Packages

firecrawl-py

🔥 The API to search, scrape, and interact with the web for AI

firecrawl

🔥 The API to search, scrape, and interact with the web for AI

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

lightnovel-crawler

Generate and download e-books from online sources.

cbbpy

A Python-based web scraper for NCAA basketball.

basketball-reference-web-scraper

NBA Stats API via Basketball Reference

crw

Fast, lightweight Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/v1/scrape, /v1/crawl, /v1/search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

vigorish

Hybrid Python/Node.js web scraper for Major League Baseball (MLB) data.

gli99

Web scraper for gifcities.org

python-sec

A client library for collecting and scraping SEC filings.

markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

facebook-page-scraper

Scrapes facebook's pages front end with no limitations & provides a feature to turn data into structured JSON or CSV

cbse-results-scraper

Parinaam is a command-line Python application that scrapes and downloads student reports of CBSE Class XII Results from http://cbseresults.nic.in.

senpwai

A desktop app for tracking and batch downloading anime

sabrmetrics

A library of web-scraping software for popular SABRmetrics websites.

goodreads-user-scraper

PyPI Package (40,000+ downloads): scrapes Goodreads user data (profile, bookshelves, books, authors, etc.)

ollama-downloader

A library and Hugging Face model downloader for Ollama.

dmr-py

Pull data from the danish vehicle registry with dmr.py

song

A command line interface for downloading Bollywood and punjabi songs

top-github-scraper

Scrape top GitHub repositories and users based on keyword

uoftscrapers

University of Toronto public web scraping scripts.

strava-cz

High level API pro interakci s webovou aplikaci Strava.cz udelane v Pythonu

esiosdata

Web Scraper para datos de demanda, producción y coste de la energía eléctrica en España, y simulador de facturación eléctrica según el PVPC

pa-scraper

Python package for Prompt API's Scraper API