openai/sparse_attention

Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"

Archived by OpenAI Python 191 forks Created Apr 2019 View on GitHub

Stars
1,614
<1% of openai's stars
Rank
#42,466
of 852,369 repos, top 5%
In Python
#7,589
of 173,292 repos, top 5%

Among 852,369 repos

Compare with

1.6k–2.5k stars: 15,648 repos, including sparse_attention

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #42,440
Next milestone
+5,591 stars to reach the top 1%
Popular
One of 66,533 repos with 1k+ stars
Yearly average
213 stars a year since Apr 2019

Stars counted Recounted daily Next count around