togethercomputer/RedPajama-Data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

by Together Python Apache-2.0 licence 371 forks Created Apr 2023 View on GitHub

Stars
4,997
24% of togethercomputer's stars
Rank
#12,925
of 847,120 repos, top 2%
In Python
#2,336
of 172,217 repos, top 2%

Among 847,120 repos

Compare with

4k–6.3k stars: 6,631 repos, including RedPajama-Data

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #12,924
Next milestone
+2,235 stars to reach the top 1%
Popular
One of 66,327 repos with 1k+ stars
Yearly average
1,397 stars a year since Apr 2023

Stars counted Recounted daily Next count around