kyegomez/Infini-attention

Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTORCH

by Kye Gomez Python MIT licence 6 forks Created Apr 2024 View on GitHub

Stars
59
<1% of kyegomez's stars
Rank
#736,349
of 851,984 repos, top 87%
In Python
#149,379
of 173,302 repos, top 87%

Among 851,984 repos

Compare with

40–63 stars: 143,700 repos, including Infini-attention

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #726,703
Next milestone
+7 stars to reach the top 80%
Yearly average
23 stars a year since Apr 2024

Stars counted Recounted daily Next count around