FMInference
Foundation Model Inference Joined Feb 2023 View on GitHub
- Stars
- 10,245
- across 3 public repos
- Rank
- #3,758
- of 94,827 organizations, top 4%
- Down 231 places this week
Repositories with 50+ stars
| Rank | Repository | Language | Stars |
|---|---|---|---|
| 6,260 | Running large language models on a single GPU for throughput-oriented scenarios. | Python | 9,340 |
| 116,848 | [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models. | Python | 541 |
| 166,012 | Python | 364 |
Among 94,827 organizations
10k–16k stars: 1,461 organizations, including FMInference
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and organizations in each band on a log scale
Where the stars are
Languages
- Python 10.2k stars, 100% · 3 repos
When they were made
3 repos with 50+ stars, made in 2023
1001k10k DejaVuH2OFlexLLMGen
Quick stats
- Next rank
- +1 star to reach #3,757
- Next milestone
- +24,728 stars to reach the top 1%
- Public repos
- 3, 3 with 50+ stars
- Popular repos
- 3 over 100 stars, 1 over 1k stars
- Top repo
- FlexLLMGen, #6,260 of all repos, 91% of stars