Webscraper Python Packages

spotifyscraper

Spotify Scraper to extract all the information from spotify, download mp3 with cover of the song

phub

A lightweight API for Pornhub

letterboxdpy

A letterboxd webscraper

hypersel

HyperSel is a Python-based framework for web automation and data scraping. It simplifies crawling, automating interactions, and data extraction from web pages. It is built with various robust tools to handle dynamic and complex web interactions efficiently, offering features such as headless browsing, proxy support, and API sniffing.

proxy-requests

a class that uses scraped proxies to make http GET/POST requests (Python requests)

scraperx

Library for scraping websites or apis at any scale

tedata

Download data from Trading Economics for free and without any account or API key. Uses selenium, javascript & bs4 to scrape data. Trading Economics is one of the greatest stores of economic data on the web and contains millions of time-series for hundreds of different countries.

isubrip

A Python package for scraping and downloading subtitles from AppleTV / iTunes movie pages.

scrape-schema

Structuring parsed data into python objects

pcpartpicker

This is an unofficial API for the website pcpartpicker.com.

aioscrapy

Python asynchronous library for web scraping

mintospy

Mintos web scraper (Updated for 2023)

web-scraper-toolkit

A powerful, standalone web scraping toolkit using Playwright and various parsers.

googlenewsscraper

A Python package that scrapes Google News article data while remaining undetected by Google. Our scraper can scrape page data up until the last page and never trigger a CAPTCHA (download stats: https://pepy.tech/project/GoogleNewsScraper)

soccer-data-api

A Python web-scrap package to get soccer data/stats.

metadatascraper

MetaDataScraper is a Python package designed to automate the extraction of follower counts and post details from a public Facebook page. It uses Selenium WebDriver for web automation and scraping. Official documentation at https://metadatascraper.readthedocs.io

scpscraper

A Python library designed for scraping data from the SCP wiki.

llm-webextract

AI-powered web content extraction — turn any website into structured JSON using LLMs and LangChain

py-mdb

Python package to both parse datsets provided by IMDb and scrape information from imdb.com

autoscrape

An automated, programming-free web scraper for interactive sites

covid-alberta

looking at some of the alberta specific covid data

pytwitterscraper

Twitter Scraper With Python

sentraltimetable

A simple Python function to summon your timetable from Sentral.

microhorario-dl

PUC-Rio Microhorario Downloader