titu1994/
Implementation of the LAMB optimizer for Keras from the paper "Reducing BERT Pre-Training Time from 3 Days to 76 Minutes"
by Somshubra Majumdar Python MIT licence 6 forks Created Apr 2019 View on GitHub
- Stars
- 74
- 1% of titu1994's stars
- Rank
- #616,544
- of 851,984 repos, top 73%
- In Python
- #124,587
- of 173,300 repos, top 72%
Among 851,984 repos
63–100 stars: 217,630 repos, including keras-LAMB-Optimizer
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #610,052
- Next milestone
- +4 stars to reach the top 70%
- Yearly average
- 10 stars a year since Apr 2019