bigscience-workshop/ Megatron-DeepSpeed
Ongoing research training transformer language models at scale, including: BERT & GPT-2
by BigScience Workshop Python Other licence 225 forks Created Jul 2021 View on GitHub
- Stars
- 1,449
- 8% of bigscience-workshop's stars
- Rank
- #47,284
- of 847,083 repos, top 6%
- In Python
- #8,481
- of 172,210 repos, top 5%
Among 847,083 repos
1k–1.6k stars: 23,526 repos, including Megatron-DeepSpeed
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #47,245
- Next milestone
- +5,784 stars to reach the top 1%
- Popular
- One of 66,319 repos with 1k+ stars
- Yearly average
- 270 stars a year since Jul 2021