zhihu/
A highly optimized LLM inference acceleration engine for Llama and its variants.
by Zhihu C++ Apache-2.0 licence 105 forks Created Dec 2024 View on GitHub
- Stars
- 906
- 4% of zhihu's stars
- Rank
- #72,886
- of 852,204 repos, top 9%
- In C++
- #3,781
- of 45,409 repos, top 9%
Among 852,204 repos
630–1k stars: 35,615 repos, including ZhiLight
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #72,801
- Next milestone
- +6,305 stars to reach the top 1%
- Popular
- One of 490,852 repos with 100+ stars
- Yearly average
- 468 stars a year since Dec 2024