kyegomez/
32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
by Kye Gomez Python MIT licence 1 fork Created Jun 2023 View on GitHub
- Stars
- 51
- <1% of kyegomez's stars
- Rank
- #822,484
- of 848,034 repos, top 97%
- In Python
- #167,151
- of 172,393 repos, top 97%
Among 848,034 repos
40–63 stars: 142,184 repos, including Blockwise-Parallel-Transformer
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #810,219
- Next milestone
- +6 stars to reach the top 90%
- Yearly average
- 15 stars a year since Jun 2023