sail-sg/
[ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
by Sea AI Lab Python MIT licence 5 forks Created Oct 2024 View on GitHub
- Stars
- 164
- 1% of sail-sg's stars
- Rank
- #326,666
- of 851,984 repos, top 39%
- In Python
- #63,987
- of 173,300 repos, top 37%
Among 851,984 repos
160–250 stars: 104,058 repos, including Attention-Sink
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #324,997
- Next milestone
- +57 stars to reach the top 30%
- Popular
- One of 490,652 repos with 100+ stars
- Yearly average
- 79 stars a year since Oct 2024