kyegomez/
Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"
by Kye Gomez Python MIT licence 17 forks Created Jan 2024 View on GitHub
- Stars
- 149
- <1% of kyegomez's stars
- Rank
- #353,067
- of 849,475 repos, top 42%
- In Python
- #69,469
- of 172,744 repos, top 41%
Among 849,475 repos
100–160 stars: 155,245 repos, including SwitchTransformers
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #351,057
- Next milestone
- +8 stars to reach the top 40%
- Popular
- One of 489,906 repos with 100+ stars
- Yearly average
- 53 stars a year since Jan 2024