tensorchord/
Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
by TensorChord Go Apache-2.0 licence 26 forks Created Jul 2023 View on GitHub
- Stars
- 282
- 2% of tensorchord's stars
- Rank
- #207,590
- of 848,034 repos, top 25%
- In Go
- #10,617
- of 34,840 repos, top 31%
Among 848,034 repos
250–400 stars: 77,212 repos, including openmodelz
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #206,997
- Next milestone
- +75 stars to reach the top 20%
- Popular
- One of 489,337 repos with 100+ stars
- Yearly average
- 85 stars a year since Jul 2023