hao-ai-lab/ LookaheadDecoding
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
by Hao AI Lab Python Apache-2.0 licence 86 forks Created Nov 2023 View on GitHub
- Stars
- 1,346
- 16% of hao-ai-lab's stars
- Rank
- #50,851
- of 852,180 repos, top 6%
- In Python
- #9,096
- of 173,254 repos, top 6%
Among 852,180 repos
1k–1.6k stars: 23,671 repos, including LookaheadDecoding
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #50,817
- Next milestone
- +5,861 stars to reach the top 1%
- Popular
- One of 66,532 repos with 1k+ stars
- Yearly average
- 452 stars a year since Nov 2023