kvcache-ai/
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
by kvcache.ai Python Apache-2.0 licence 1,600 forks Created Jul 2024 View on GitHub
- Stars
- 19,661
- 64% of kvcache-ai's stars
- Rank
- #2,412
- of 852,204 repos, top 0.3%
- Down 14 places this week
- In Python
- #472
- of 173,304 repos, top 0.3%
Among 852,204 repos
16k–25k stars: 1,435 repos, including ktransformers
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +10 stars to reach #2,411
- Next milestone
- +18,479 stars to reach the top 0.1%
- Popular
- One of 5,759 repos with 10k+ stars
- Yearly average
- 8,551 stars a year since Jul 2024