jzhang38/
Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
by Zhang Peiyuan Python Apache-2.0 licence 52 forks Created Apr 2024 View on GitHub
- Stars
- 759
- 8% of jzhang38's stars
- Rank
- #86,033
- of 852,180 repos, top 11%
- In Python
- #15,769
- of 173,254 repos, top 10%
Among 852,180 repos
630–1k stars: 35,620 repos, including EasyContext
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #85,921
- Next milestone
- +8 stars to reach the top 10%
- Popular
- One of 490,958 repos with 100+ stars
- Yearly average
- 291 stars a year since Apr 2024