lucidrains/
Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
by Phil Wang Python MIT licence 51 forks Created Feb 2025 View on GitHub
- Stars
- 816
- <1% of lucidrains's stars
- Rank
- #80,363
- of 851,984 repos, top 10%
- In Python
- #14,676
- of 173,300 repos, top 9%
Among 851,984 repos
630–1k stars: 35,594 repos, including native-sparse-attention-pytorch
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #80,273
- Next milestone
- +6,404 stars to reach the top 1%
- Popular
- One of 490,652 repos with 100+ stars
- Yearly average
- 471 stars a year since Feb 2025