vllm-project/
State-of-the-art LLM compression, built for production inference with vLLM
by vLLM Python Apache-2.0 licence 732 forks Created Jun 2024 View on GitHub
- Stars
- 3,966
- 3% of vllm-project's stars
- Rank
- #16,757
- of 852,119 repos, top 2%
- In Python
- #2,996
- of 173,305 repos, top 2%
Among 852,119 repos
2.5k–4k stars: 10,614 repos, including llm-compressor
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #16,751
- Next milestone
- +3,246 stars to reach the top 1%
- Popular
- One of 66,549 repos with 1k+ stars
- Yearly average
- 1,655 stars a year since Jun 2024