scrapy/dirbot

Scrapy project to scrape public web directories (educational) [DEPRECATED]

by Scrapy project Python 1,039 forks Created Apr 2011 View on GitHub

Stars
1,629
2% of scrapy's stars
Rank
#42,047
of 847,083 repos, top 5%
In Python
#7,527
of 172,210 repos, top 5%

Among 847,083 repos

Compare with

1.6k–2.5k stars: 15,615 repos, including dirbot

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #42,013
Next milestone
+5,604 stars to reach the top 1%
Popular
One of 66,319 repos with 1k+ stars
Yearly average
105 stars a year since Apr 2011

Stars counted Recounted daily Next count around