hao-ai-lab/LookaheadDecoding

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

by Hao AI Lab Python Apache-2.0 licence 86 forks Created Nov 2023 View on GitHub

Stars
1,346
16% of hao-ai-lab's stars
Rank
#50,851
of 852,180 repos, top 6%
In Python
#9,096
of 173,254 repos, top 6%

Among 852,180 repos

Compare with

1k–1.6k stars: 23,671 repos, including LookaheadDecoding

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #50,817
Next milestone
+5,861 stars to reach the top 1%
Popular
One of 66,532 repos with 1k+ stars
Yearly average
452 stars a year since Nov 2023

Stars counted Recounted daily Next count around