lucidrains/
Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
by Phil Wang Python MIT licence 36 forks Created Mar 2022 View on GitHub
- Stars
- 395
- <1% of lucidrains's stars
- Rank
- #155,061
- of 851,984 repos, top 19%
- In Python
- #29,222
- of 173,300 repos, top 17%
Among 851,984 repos
250–400 stars: 77,404 repos, including memory-efficient-attention-pytorch
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #154,727
- Next milestone
- +372 stars to reach the top 10%
- Popular
- One of 490,652 repos with 100+ stars
- Yearly average
- 84 stars a year since Mar 2022