modular/llm-inference-handbook

Everything you need to know about LLM inference

by Modular Inc TypeScript Apache-2.0 licence 60 forks Created Jul 2025 View on GitHub

Stars
481
1% of modular's stars
Rank
#130,248
of 852,045 repos, top 16%
In TypeScript
#11,841
of 62,463 repos, top 19%

Among 852,045 repos

Compare with

400–630 stars: 51,556 repos, including llm-inference-handbook

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #129,994
Next milestone
+286 stars to reach the top 10%
Popular
One of 490,720 repos with 100+ stars
Yearly average
355 stars a year since Jul 2025

Stars counted Recounted daily Next count around