dusty-nv/
Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
by Dustin Franklin Python MIT licence 67 forks Created Mar 2024 View on GitHub
- Stars
- 380
- 2% of dusty-nv's stars
- Rank
- #160,406
- of 852,119 repos, top 19%
- In Python
- #30,301
- of 173,305 repos, top 18%
Among 852,119 repos
250–400 stars: 77,415 repos, including NanoLLM
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #160,034
- Next milestone
- +387 stars to reach the top 10%
- Popular
- One of 490,778 repos with 100+ stars
- Yearly average
- 145 stars a year since Mar 2024