VITA-Group/
[ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal, Shiwei Liu, Zhangyang Wang
by VITA Python Apache-2.0 licence 4 forks Created Feb 2023 View on GitHub
- Stars
- 56
- <1% of VITA-Group's stars
- Rank
- #767,354
- of 852,045 repos, top 91%
- In Python
- #155,792
- of 173,300 repos, top 90%
Among 852,045 repos
40–63 stars: 143,701 repos, including Random-MoE-as-Dropout
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #756,693
- Next milestone
- +1 star to reach the top 90%
- Yearly average
- 15 stars a year since Feb 2023