BlinkDL/
LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
by PENG Bo Python 4 forks Created Feb 2022 View on GitHub
- Stars
- 61
- <1% of BlinkDL's stars
- Rank
- #713,808
- of 847,120 repos, top 85%
- In Python
- #144,571
- of 172,217 repos, top 84%
Among 847,120 repos
40–63 stars: 142,367 repos, including SmallInitEmb
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #704,754
- Next milestone
- +5 stars to reach the top 80%
- Yearly average
- 13 stars a year since Feb 2022