kyegomez/LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

by Kye Gomez Python Apache-2.0 licence 59 forks Created Jul 2023 View on GitHub

Stars
728
2% of kyegomez's stars
Rank
#89,187
of 847,188 repos, top 11%
In Python
#16,381
of 172,244 repos, top 10%

Among 847,188 repos

Compare with

630–1k stars: 35,533 repos, including LongNet

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #89,063
Next milestone
+41 stars to reach the top 10%
Popular
One of 488,466 repos with 100+ stars
Yearly average
217 stars a year since Jul 2023

Stars counted Recounted daily Next count around