togethercomputer/ RedPajama-Data
The RedPajama-Data repository contains code for preparing large datasets for training large language models.
by Together Python Apache-2.0 licence 371 forks Created Apr 2023 View on GitHub
- Stars
- 4,997
- 24% of togethercomputer's stars
- Rank
- #12,925
- of 847,120 repos, top 2%
- In Python
- #2,336
- of 172,217 repos, top 2%
Among 847,120 repos
4k–6.3k stars: 6,631 repos, including RedPajama-Data
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #12,924
- Next milestone
- +2,235 stars to reach the top 1%
- Popular
- One of 66,327 repos with 1k+ stars
- Yearly average
- 1,397 stars a year since Apr 2023