ModelTC/ LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
by ModelTC Python Apache-2.0 licence 385 forks Created Jul 2023 View on GitHub
- Stars
- 4,359
- 35% of ModelTC's stars
- Rank
- #15,107
- of 847,086 repos, top 2%
- In Python
- #2,691
- of 172,210 repos, top 2%
Among 847,086 repos
4k–6.3k stars: 6,633 repos, including LightLLM
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #15,104
- Next milestone
- +2,874 stars to reach the top 1%
- Popular
- One of 66,308 repos with 1k+ stars
- Yearly average
- 1,318 stars a year since Jul 2023