modelscope/ dash-infer
DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including CUDA, x86 and ARMv9.
by ModelScope C Apache-2.0 licence 29 forks Created Apr 2024 View on GitHub
- Stars
- 272
- <1% of modelscope's stars
- Rank
- #213,696
- of 847,086 repos, top 26%
- In C
- #8,395
- of 32,546 repos, top 26%
Among 847,086 repos
250–400 stars: 77,108 repos, including dash-infer
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #213,035
- Next milestone
- +84 stars to reach the top 20%
- Popular
- One of 488,402 repos with 100+ stars
- Yearly average
- 104 stars a year since Apr 2024