amitshekhariitbhu/llm-inference-engineering

Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.

by AMIT SHEKHAR Markdown Apache-2.0 licence 51 forks Created Aug 2026 View on GitHub

Stars
411
1% of amitshekhariitbhu's stars
Rank
#149,726
of 851,984 repos, top 18%

Among 851,984 repos

400–630 stars: 51,570 repos, including llm-inference-engineering

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #149,378
Next milestone
+356 stars to reach the top 10%
Popular
One of 490,652 repos with 100+ stars

Stars counted Recounted daily Next count around