bytedance/
KV cache store for distributed LLM inference
by Bytedance Inc. C++ Apache-2.0 licence 48 forks Created Sept 2024 View on GitHub
- Stars
- 452
- <1% of bytedance's stars
- Rank
- #137,068
- of 847,083 repos, top 17%
- In C++
- #7,247
- of 45,199 repos, top 17%
Among 847,083 repos
400–630 stars: 51,358 repos, including InfiniStore
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #136,831
- Next milestone
- +317 stars to reach the top 10%
- Popular
- One of 488,395 repos with 100+ stars
- Yearly average
- 207 stars a year since Sept 2024