scrapy

Scrapy project Joined Apr 2011 View on GitHub

Stars
77,421
across 33 public repos
Rank
#317
of 94,827 organizations, top 0.3%
Down 9 places this week

Repositories with 50+ stars

scrapy's repositories with their overall rank
RankRepositoryLanguageStars
336

Scrapy, a fast high-level web crawling & scraping framework for Python.

Python 65,313
21,769

A service daemon to run Scrapy spiders

Python 3,099
36,298

A pure-python HTML screen-scraping library

HTML 1,881
42,043

Scrapy project to scrape public web directories (educational) [DEPRECATED]

Python 1,629
50,022

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Python 1,368
50,343

This is a sample Scrapy project for educational purposes

Python 1,359
84,325

Command line client for Scrapyd server

Python 772
145,627

Python library of web-related functions

HTML 422
189,431

CSS Selectors for Python

Python 313
195,939

Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python

Python 301
209,023

Fill HTML login forms automatically

Python 279
252,363 223
495,786

A pure-Python robots.txt parser with support for modern conventions.

DIGITAL Command Language 97
633,655

Common interface for data container classes

Python 71
671,363

The scrapy.org website (old code)

HTML 66

Among 94,827 organizations

63k–100k stars: 206 organizations, including scrapy

Stars along the bottom, and organizations in each band on a log scale

Where the stars are

Languages

  1. Python 74.5k stars, 96% · 10 repos
  2. HTML 2.4k stars, 3% · 3 repos
  3. DIGITAL Command Language 97 stars, <1% · 1 repo

When they were made

15 repos with 50+ stars, made between 2010 and 2020

Quick stats

Next rank
+122 stars to reach #316
Next milestone
+113,348 stars to reach the top 0.1%
Public repos
33, 15 with 50+ stars
Popular repos
6 over 1k stars, 1 over 10k stars
Top repo
scrapy, #336 of all repos, 84% of stars
Smaller repos
228 stars from repos under 50

Stars counted Recounted daily Next count around