danielmiessler/
A curated list of the most common and most interesting robots.txt disallowed directories.
by Daniel Miessler 🛡️ Shell 304 forks Created Sept 2015 View on GitHub
- Stars
- 1,500
- 1% of danielmiessler's stars
- Rank
- #45,641
- of 847,070 repos, top 6%
- In Shell
- #1,082
- of 22,138 repos, top 5%
Among 847,070 repos
1k–1.6k stars: 23,510 repos, including RobotsDisallowed
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #45,612
- Next milestone
- +5,730 stars to reach the top 1%
- Popular
- One of 66,291 repos with 1k+ stars
- Yearly average
- 135 stars a year since Sept 2015