kyegomez/
Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
by Kye Gomez Python MIT licence 9 forks Created Apr 2024 View on GitHub
- Stars
- 124
- <1% of kyegomez's stars
- Rank
- #410,322
- of 851,992 repos, top 49%
- In Python
- #81,531
- of 173,304 repos, top 48%
Among 851,992 repos
100–160 stars: 155,455 repos, including Mixture-of-Depths
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #407,750
- Next milestone
- +32 stars to reach the top 40%
- Popular
- One of 490,655 repos with 100+ stars
- Yearly average
- 47 stars a year since Apr 2024