lucidrains/
A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
by Phil Wang Python MIT licence 70 forks Created Jul 2020 View on GitHub
- Stars
- 876
- <1% of lucidrains's stars
- Rank
- #75,176
- of 851,992 repos, top 9%
- In Python
- #13,674
- of 173,304 repos, top 8%
Among 851,992 repos
630–1k stars: 35,592 repos, including mixture-of-experts
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #75,096
- Next milestone
- +6,344 stars to reach the top 1%
- Popular
- One of 490,655 repos with 100+ stars
- Yearly average
- 138 stars a year since Jul 2020