Lightning-AI/LitServe

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

by ⚡️ Lightning AI Python Apache-2.0 licence 329 forks Created Dec 2023 View on GitHub

Stars
3,997
6% of Lightning-AI's stars
Rank
#16,617
of 852,180 repos, top 2%
In Python
#2,970
of 173,254 repos, top 2%

Among 852,180 repos

Compare with

2.5k–4k stars: 10,608 repos, including LitServe

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #16,608
Next milestone
+3,210 stars to reach the top 1%
Popular
One of 66,532 repos with 1k+ stars
Yearly average
1,370 stars a year since Dec 2023

Stars counted Recounted daily Next count around