ModelTC/LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

by ModelTC Python Apache-2.0 licence 385 forks Created Jul 2023 View on GitHub

Stars
4,359
35% of ModelTC's stars
Rank
#15,107
of 847,086 repos, top 2%
In Python
#2,691
of 172,210 repos, top 2%

Among 847,086 repos

Compare with

4k–6.3k stars: 6,633 repos, including LightLLM

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #15,104
Next milestone
+2,874 stars to reach the top 1%
Popular
One of 66,308 repos with 1k+ stars
Yearly average
1,318 stars a year since Jul 2023

Stars counted Recounted daily Next count around