kyegomez/ LongNet
Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
by Kye Gomez Python Apache-2.0 licence 59 forks Created Jul 2023 View on GitHub
- Stars
- 728
- 2% of kyegomez's stars
- Rank
- #89,187
- of 847,188 repos, top 11%
- In Python
- #16,381
- of 172,244 repos, top 10%
Among 847,188 repos
630–1k stars: 35,533 repos, including LongNet
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #89,063
- Next milestone
- +41 stars to reach the top 10%
- Popular
- One of 488,466 repos with 100+ stars
- Yearly average
- 217 stars a year since Jul 2023