internetarchive

Internet Archive Joined Sept 2009 View on GitHub

Stars: 17,852; across 234 public repos
Rank: #2,107; of 94,827 organizations, top 3%

Repositories with 50+ stars

internetarchive's repositories with their overall rank
Rank	Repository	Language	Stars
9,051	openlibrary One webpage for every book ever published!	Python	6,818
20,064	heritrix3 Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.	Java	3,349
56,953	bookreader The Internet Archive BookReader	JavaScript	1,188
74,957	wayback-machine-webextension A web browser extension for Chrome, Firefox, Edge, and Safari 14.	JavaScript	875
79,399	brozzler brozzler - distributed browser-based web crawler	Python	823
123,230	openlibrary-client Python Client Library for the Archive.org OpenLibrary API	Python	510
132,922	warcprox WARC writing MITM HTTP/S proxy	Python	468
141,481	Zeno State-of-the-art web crawler 🔱	Go	436
177,652	dweb-mirror Offline Internet Archive project	JavaScript	337
228,622	warc Python library for reading and writing warc files	Python	251
304,007	warctools Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)	Python	178
334,016	internetarchivebot	PHP	159
341,112	archive-pdf-tools Fast PDF generation and compression. Deals with millions of pages daily.	Python	155
372,809	bookserver Archive.org OPDS Bookserver - A standard for digital book distribution	Python	139
413,983	fatcat Perpetual Access To The Scholarly Record	Python	122
480,756	cdx-summary Summarize web archive capture index (CDX) files.	Python	101
544,989	fatcat-scholar search interface for scholarly works	Python	86
583,124	openlibrary-bots A repository of cleanup bots implementing the openlibrary-client	Python	79
607,098	iaux Monorepo for Archive.org UX development and prototyping.	TypeScript	75
640,688	hind Hashistack-IN-Docker (single container with nomad + consul + caddy)	Shell	70
648,236	umbra A queue-controlled browser automation tool for improving web crawl quality	Python	69
713,763	wayback-machine-firefox Reduce annoying 404 pages by automatically checking for an archived copy in the Wayback Machine. Learn more about this Test Pilot experiment at https://testpilot.firefox.com/	JavaScript	61
732,699	dweb-archive	JavaScript	59
732,699	archive-hocr-tools Efficient hOCR tooling	Python	59
763,331	gowarc Read and write WARC files in Go	Go	56
809,287	internet-archive-voice-apps Voice Apps (Actions on Google, Alexa Skill) of Internet Archive. Just say: "Ok Google, Ask Internet Archive to Play Jazz" or "Alexa, Ask Internet Internet Archive to play Instrumental Music"	JavaScript	52

Among 94,827 organizations

16k–25k stars: 923 organizations, including internetarchive

top 50%top 10%top 1%top 0.1%

Stars along the bottom, and organizations in each band on a log scale

Where the stars are

openlibrary 6.8k, 38%heritrix3 3.3k, 19%

Smaller repos 1.3k, 7%

bookreader 1.2k, 7%wayback-machine-webextension 875, 5%brozzler 823, 5%openlibrary-client 510, 3%warcprox 468, 3%Zeno 436, 2%

7 more repos 426, 2%

dweb-mirror 337, 2%warc 251, 1%warctools 178, 1%internetarchivebot 159, 1%archive-pdf-tools 155, 1%bookserver 139, 1%fatcat 122, 1%cdx-summary 101, 1%fatcat-scholar 86, <1%openlibrary-bots 79, <1%iaux 75, <1%

Languages

Python 9.9k stars, 55% · 14 repos
Java 3.3k stars, 19% · 1 repo
JavaScript 2.6k stars, 14% · 6 repos
Go 492 stars, 3% · 2 repos
PHP 159 stars, 1% · 1 repo
TypeScript 75 stars, <1% · 1 repo
Shell 70 stars, <1% · 1 repo

When they were made

26 repos with 50+ stars, made between 2008 and 2022

101001k10k bookreaderheritrix3openlibrary

Quick stats

Next rank: +1 star to reach #2,106
Next milestone: +17,142 stars to reach the top 1%
Public repos: 234, 26 with 50+ stars
Popular repos: 16 over 100 stars, 3 over 1k stars
Top repo: openlibrary, #9,051 of all repos, 38% of stars
Smaller repos: 1,277 stars from repos under 50