wangy8961/ python3-concurrency-pics-02
爬取 www.mzitu.com 全站图片,截至目前共5162个图集,16.5万多张美女图片,使用 asyncio 和 aiohttp 实现的异步版本只需要不到2小时就能爬取完成。按日期创建图集目录,保存更合理。控制台只显示下载的进度条,详细信息保存在日志文件中。支持异常处理,不会终止爬虫程序。失败的请求,下次再执行爬虫程序时会自动下载
by Madman Python 82 forks Created Aug 2018 View on GitHub
- Stars
- 333
- 22% of wangy8961's stars
- Rank
- #180,270
- of 851,992 repos, top 22%
- In Python
- #34,239
- of 173,304 repos, top 20%
Among 851,992 repos
250–400 stars: 77,404 repos, including python3-concurrency-pics-02
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #179,820
- Next milestone
- +23 stars to reach the top 20%
- Popular
- One of 490,655 repos with 100+ stars
- Yearly average
- 41 stars a year since Aug 2018