scrapy/
A pure-Python robots.txt parser with support for modern conventions.
by Scrapy project DIGITAL Command Language BSD-3-Clause licence 39 forks Created Jun 2019 View on GitHub
- Stars
- 97
- <1% of scrapy's stars
- Rank
- #498,345
- of 852,369 repos, top 59%
Among 852,369 repos
63–100 stars: 217,645 repos, including protego
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #494,594
- Next milestone
- +22 stars to reach the top 50%
- Yearly average
- 13 stars a year since Jun 2019