EricLBuehler/
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
by Eric Buehler Rust MIT licence 91 forks Created Oct 2023 View on GitHub
- Stars
- 741
- 8% of EricLBuehler's stars
- Rank
- #87,991
- of 851,984 repos, top 11%
- In Rust
- #3,179
- of 24,094 repos, top 14%
Among 851,984 repos
630–1k stars: 35,599 repos, including candle-vllm
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #87,892
- Next milestone
- +26 stars to reach the top 10%
- Popular
- One of 490,650 repos with 100+ stars
- Yearly average
- 243 stars a year since Oct 2023