kyegomez/ Infini-attention
Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTORCH
by Kye Gomez Python MIT licence 6 forks Created Apr 2024 View on GitHub
- Stars
- 59
- <1% of kyegomez's stars
- Rank
- #736,349
- of 851,984 repos, top 87%
- In Python
- #149,379
- of 173,302 repos, top 87%
Among 851,984 repos
40–63 stars: 143,700 repos, including Infini-attention
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #726,703
- Next milestone
- +7 stars to reach the top 80%
- Yearly average
- 23 stars a year since Apr 2024