OpenCSGs/
llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing...
by OpenCSG Python Apache-2.0 licence 17 forks Created Feb 2024 View on GitHub
- Stars
- 99
- 2% of OpenCSGs's stars
- Rank
- #490,651
- of 851,984 repos, top 58%
- In Python
- #98,049
- of 173,302 repos, top 57%
Among 851,984 repos
63–100 stars: 217,634 repos, including llm-inference
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #486,859
- Next milestone
- +20 stars to reach the top 50%
- Yearly average
- 37 stars a year since Feb 2024