Tiiny-AI/ PowerInfer
High-speed Large Language Model Serving for Local Deployment
by Tiiny AI C++ MIT licence 618 forks Created Dec 2023 View on GitHub
- Stars
- 9,876
- 100% of Tiiny-AI's stars
- Rank
- #5,830
- of 847,083 repos, top 0.7%
- In C++
- #290
- of 45,199 repos, top 0.6%
Among 847,083 repos
6.3k–10k stars: 4,197 repos, including PowerInfer
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #5,829
- Next milestone
- +28,269 stars to reach the top 0.1%
- Popular
- One of 66,319 repos with 1k+ stars
- Yearly average
- 3,396 stars a year since Dec 2023