patchy631/ time-to-first-token
A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.
by Akshay Pachaar HTML Apache-2.0 licence 137 forks Created Aug 2026 View on GitHub
- Stars
- 1,169
- 3% of patchy631's stars
- Rank
- #57,930
- of 852,204 repos, top 7%
- In HTML
- #1,367
- of 24,477 repos, top 6%
Among 852,204 repos
1k–1.6k stars: 23,672 repos, including time-to-first-token
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #57,890
- Next milestone
- +6,042 stars to reach the top 1%
- Popular
- One of 66,543 repos with 1k+ stars