rom1504/cc2dataset

Easily convert common crawl to a dataset of caption and document. Image/text Audio/text Video/text, ...

by Romain Beaumont Python MIT licence 26 forks Created Nov 2022 View on GitHub

Stars
322
4% of rom1504's stars
Rank
#185,354
of 848,579 repos, top 22%
In Python
#35,282
of 172,528 repos, top 21%

Among 848,579 repos

Compare with

250–400 stars: 77,237 repos, including cc2dataset

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #184,851
Next milestone
+35 stars to reach the top 20%
Popular
One of 489,552 repos with 100+ stars
Yearly average
81 stars a year since Nov 2022

Stars counted Recounted daily Next count around