scrapinghub/aduana

Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even when making big crawls (one billion pages).

Archived by Scrapinghub C BSD-3-Clause licence 8 forks Created May 2015 View on GitHub

Stars
54
<1% of scrapinghub's stars
Rank
#789,991
of 852,119 repos, top 93%
In C
#30,367
of 32,726 repos, top 93%

Among 852,119 repos

Compare with

40–63 stars: 143,710 repos, including aduana

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #778,575
Next milestone
+3 stars to reach the top 90%
Yearly average
5 stars a year since May 2015

Stars counted Recounted daily Next count around