FMInference/
Running large language models on a single GPU for throughput-oriented scenarios.
Archived by Foundation Model Inference Python Apache-2.0 licence 588 forks Created Feb 2023 View on GitHub
- Stars
- 9,340
- 91% of FMInference's stars
- Rank
- #6,260
- of 847,083 repos, top 0.7%
- In Python
- #1,158
- of 172,210 repos, top 0.7%
Among 847,083 repos
6.3k–10k stars: 4,197 repos, including FlexLLMGen
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #6,259
- Next milestone
- +28,805 stars to reach the top 0.1%
- Popular
- One of 66,319 repos with 1k+ stars
- Yearly average
- 2,500 stars a year since Feb 2023