lucidrains/local-attention

An implementation of local windowed attention for language modeling

by Phil Wang Python MIT licence 52 forks Created Jul 2020 View on GitHub

Stars
505
<1% of lucidrains's stars
Rank
#124,833
of 851,984 repos, top 15%
In Python
#23,269
of 173,300 repos, top 14%

Among 851,984 repos

Compare with

400–630 stars: 51,570 repos, including local-attention

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #124,613
Next milestone
+262 stars to reach the top 10%
Popular
One of 490,652 repos with 100+ stars
Yearly average
79 stars a year since Jul 2020

Stars counted Recounted daily Next count around