jundot/
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
by Jun Kim Python Apache-2.0 licence 2,125 forks Created Feb 2026 View on GitHub
- Stars
- 23,579
- 100% of jundot's stars
- Rank
- #1,880
- of 852,204 repos, top 0.2%
- Up 11 places this week
- In Python
- #386
- of 173,304 repos, top 0.2%
Among 852,204 repos
16k–25k stars: 1,435 repos, including omlx
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +6 stars to reach #1,879
- Next milestone
- +14,561 stars to reach the top 0.1%
- Popular
- One of 5,759 repos with 10k+ stars