Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

by Tiiny AI C++ MIT licence 618 forks Created Dec 2023 View on GitHub

Stars
9,876
100% of Tiiny-AI's stars
Rank
#5,830
of 847,083 repos, top 0.7%
In C++
#290
of 45,199 repos, top 0.6%

Among 847,083 repos

Compare with

6.3k–10k stars: 4,197 repos, including PowerInfer

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #5,829
Next milestone
+28,269 stars to reach the top 0.1%
Popular
One of 66,319 repos with 1k+ stars
Yearly average
3,396 stars a year since Dec 2023

Stars counted Recounted daily Next count around