cytopia/crawlpy

Scrapy python crawler/spider with post/get login (handles CSRF), variable level of recursions and optionally save to disk

by cytopia Python MIT licence 10 forks Created Jul 2016 View on GitHub

Stars
54
<1% of cytopia's stars
Rank
#785,752
of 847,120 repos, top 93%
In Python
#159,459
of 172,217 repos, top 93%

Among 847,120 repos

Compare with

40–63 stars: 142,367 repos, including crawlpy

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #774,427
Next milestone
+3 stars to reach the top 90%
Yearly average
5 stars a year since Jul 2016

Stars counted Recounted daily Next count around