cloneofsimo/
Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
by Simo Ryu Python 3 forks Created Dec 2023 View on GitHub
- Stars
- 89
- 1% of cloneofsimo's stars
- Rank
- #533,220
- of 852,180 repos, top 63%
- In Python
- #106,981
- of 173,254 repos, top 62%
Among 852,180 repos
63–100 stars: 217,627 repos, including ezmup
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #528,508
- Next milestone
- +5 stars to reach the top 60%
- Yearly average
- 31 stars a year since Dec 2023