wangy8961/python3-concurrency-pics-02

爬取 www.mzitu.com 全站图片,截至目前共5162个图集,16.5万多张美女图片,使用 asyncio 和 aiohttp 实现的异步版本只需要不到2小时就能爬取完成。按日期创建图集目录,保存更合理。控制台只显示下载的进度条,详细信息保存在日志文件中。支持异常处理,不会终止爬虫程序。失败的请求,下次再执行爬虫程序时会自动下载

by Madman Python 82 forks Created Aug 2018 View on GitHub

Stars
333
22% of wangy8961's stars
Rank
#180,270
of 851,992 repos, top 22%
In Python
#34,239
of 173,304 repos, top 20%

Among 851,992 repos

Compare with

250–400 stars: 77,404 repos, including python3-concurrency-pics-02

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #179,820
Next milestone
+23 stars to reach the top 20%
Popular
One of 490,655 repos with 100+ stars
Yearly average
41 stars a year since Aug 2018

Stars counted Recounted daily Next count around