openai/ sparse_attention
Examples of using sparse attention, as in "Generating Long Sequences with Sparse Transformers"
Archived by OpenAI Python 191 forks Created Apr 2019 View on GitHub
- Stars
- 1,614
- <1% of openai's stars
- Rank
- #42,466
- of 852,369 repos, top 5%
- In Python
- #7,589
- of 173,292 repos, top 5%
Among 852,369 repos
1.6k–2.5k stars: 15,648 repos, including sparse_attention
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #42,440
- Next milestone
- +5,591 stars to reach the top 1%
- Popular
- One of 66,533 repos with 1k+ stars
- Yearly average
- 213 stars a year since Apr 2019