Wayback Machine Python Packages

waybackpy

Wayback Machine API interface & a command-line tool

archivebox

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

archive-query-log

📜 The Archive Query Log.

history4feed

Creates a complete full text historical archive for an RSS or ATOM feed.

scrapy-wayback-middleware

Scrapy middleware for submitting URLs to the Internet Archive Wayback Machine

pywaybackup

Query and download archive.org as simple as possible.

beastcrypt

​Advanced JS Reconnaissance Tool | Wayback & Katana Integration | Auto-Source Map Discovery Automated engine to hunt for exposed secrets, API keys, and sensitive endpoints by analyzing historical JS files and automatically locating hidden .map files.

archivooor

Archivooor is a Python package for interacting with the archive.org API.

wayback-machine-archiver

A Python script to submit web pages to the Wayback Machine for archiving.

wbsv

CLI for archiving pages and its all links to Wayback Machine

wayback-archive

A comprehensive tool for downloading and archiving websites from the Wayback Machine

wayback-utils

Wayback Machine utils (web.archive.org)

hoardy-web

Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing, replay, mirroring, data scraping, and/or indexing. Your own personal private Wayback Machine that can also archive HTTP POST requests and responses, as well as most other HTTP-level data.

waybacktweets

Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing, and saves the data.

pyarchiveit

A Python library to interact with the Internet Archive's Archive-It Account API (https://support.archive-it.org/hc/en-us/articles/360032747311-Access-your-account-with-the-Archive-It-Partner-API)

yawbdl

A tool to download pages from Internet Archive.

archive-md-urls

Turn URLs in Markdown files into archive.org snapshots

scrapy-wayback-machine

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

wayback-machine-scraper

A command-line utility for scraping Wayback Machine snapshots from archive.org.

wayback-diff

Intelligent web page comparison tool with Wayback Machine support and visual regression testing

gau-python

This library gets urls from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl. Inspired by Corbin Leo's gau

twilog-web-archiver

Save month list pages of twilog.org by using archive.org

get-wayback-machine

Fetch a URL via the latest Wayback Machine Snapshot

hoardy-web-sas

Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing, replay, mirroring, data scraping, and/or indexing. Your own personal private Wayback Machine that can also archive HTTP POST requests and responses, as well as most other HTTP-level data.