huggingface/datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

by Hugging Face Python Apache-2.0 licence 327 forks Created Jun 2023 View on GitHub

Stars
3,419
<1% of huggingface's stars
Rank
#19,674
of 852,369 repos, top 3%
In Python
#3,541
of 173,292 repos, top 3%

Among 852,369 repos

Compare with

2.5k–4k stars: 10,608 repos, including datatrove

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #19,669
Next milestone
+3,786 stars to reach the top 1%
Popular
One of 66,533 repos with 1k+ stars
Yearly average
1,001 stars a year since Jun 2023

Stars counted Recounted daily Next count around