Lightning-AI/ LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
by ⚡️ Lightning AI Python Apache-2.0 licence 329 forks Created Dec 2023 View on GitHub
- Stars
- 3,997
- 6% of Lightning-AI's stars
- Rank
- #16,617
- of 852,180 repos, top 2%
- In Python
- #2,970
- of 173,254 repos, top 2%
Among 852,180 repos
2.5k–4k stars: 10,608 repos, including LitServe
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #16,608
- Next milestone
- +3,210 stars to reach the top 1%
- Popular
- One of 66,532 repos with 1k+ stars
- Yearly average
- 1,370 stars a year since Dec 2023