Web Scraping Python Python Packages

seleniumbase

APIs for browser automation, testing, and bypassing bot-detection.

scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

scrapegraph-py

Official Python SDK for the ScrapeGraph AI API. Smart scraping, search, crawling, markdownify, agentic browser automation, scheduled jobs, and structured data extraction

httpmorph

httpmorph is a drop-in replacement for Python's requests library that uses a custom C implementation with BoringSSL instead of Python's standard HTTP stack.

wrapper-tls-requests

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

pytest-sbase

APIs for browser automation, testing, and bypassing bot-detection.

sbase

APIs for browser automation, testing, and bypassing bot-detection.

pytest-seleniumbase

APIs for browser automation, testing, and bypassing bot-detection.

botasaurus

The All in One Framework to Build Undefeatable Scrapers

selenium-base

APIs for browser automation, testing, and bypassing bot-detection.

bota

The All in One Framework to Build Undefeatable Scrapers

javascript-fixes

The All in One Framework to Build Undefeatable Scrapers

botasaurus-humancursor

The All in One Framework to Build Undefeatable Scrapers

basecase

APIs for browser automation, testing, and bypassing bot-detection.

gli99

Web scraper for gifcities.org

parallaxapis-sdk-py

ParallaxAPIs SDK

botasaurus-server

The All in One Framework to Build Undefeatable Scrapers

tiny-web-crawler

A simple and easy to use web crawler for Python

aminer-scrapy

A high-level Web Crawling and Web Scraping framework

bose

The All in One Framework to Build Undefeatable Scrapers

strava-cz

High level API pro interakci s webovou aplikaci Strava.cz udelane v Pythonu

oots-get

Download all 'Order of the Stick' comics for local reading.

cobweb-lnx

CobWeb is a Python library for web scraping. The library consists of two classes: Spider and Scraper.