PuerkitoBio/
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
by PuerkitoBio Go BSD-3-Clause licence 92 forks Created Jan 2014 View on GitHub
- Stars
- 790
- 4% of PuerkitoBio's stars
- Rank
- #82,597
- of 847,120 repos, top 10%
- In Go
- #4,901
- of 34,822 repos, top 15%
Among 847,120 repos
630–1k stars: 35,521 repos, including fetchbot
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #82,496
- Next milestone
- +6,442 stars to reach the top 1%
- Popular
- One of 488,400 repos with 100+ stars
- Yearly average
- 61 stars a year since Jan 2014