PyPI Stats
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About
Home

Search Packages

Find Python packages by name, description, GitHub topic, or filter by metrics
shengchenyang
ayugespidertools

使 scrapy 开发不用在意 item,pipeline,middleware 等通用场景下模块的编写,解放开发者的双手。

7K 99 16
stummjr
scrapy-fieldstats

A Scrapy extension to log items coverage when the spider shuts down

544 19 4
sangaline
scrapy-wayback-machine

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

415 122 32
abebus
spider-info-webservice

Scrapy extension for monitoring spider.

152 1 0
crawlaio
scrapy-spiderstats-extension

将 Spider Stats 存储到 MongoDB 的扩展,可以用于爬虫监控和统计

121 1 0
rudeigerc
scrapy-slackbot

A Scrapy extension to send notification to the Slack channel.

109 9 3
sp1thas
scrapy-folder-tree

[MIRROR OF https://codeberg.org/sp1thas/scrapy-folder-tree] A scrapy pipeline which stores files using folder trees.

70 9 3
    • Data from PyPI, GitHub, ClickHouse, and BigQuery