lukemelas/do-you-even-need-attention

Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)

by Luke Melas-Kyriazi Python 31 forks Created May 2021 View on GitHub

Stars
485
4% of lukemelas's stars
Rank
#129,237
of 851,984 repos, top 16%
In Python
#24,121
of 173,300 repos, top 14%

Among 851,984 repos

Compare with

400–630 stars: 51,570 repos, including do-you-even-need-attention

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #128,992
Next milestone
+282 stars to reach the top 10%
Popular
One of 490,652 repos with 100+ stars
Yearly average
88 stars a year since May 2021

Stars counted Recounted daily Next count around