amitshekhariitbhu/ llm-inference-engineering
Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
by AMIT SHEKHAR Markdown Apache-2.0 licence 51 forks Created Aug 2026 View on GitHub
- Stars
- 411
- 1% of amitshekhariitbhu's stars
- Rank
- #149,726
- of 851,984 repos, top 18%
Among 851,984 repos
400–630 stars: 51,570 repos, including llm-inference-engineering
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #149,378
- Next milestone
- +356 stars to reach the top 10%
- Popular
- One of 490,652 repos with 100+ stars