modelscope/dash-infer

DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including CUDA, x86 and ARMv9.

by ModelScope C Apache-2.0 licence 29 forks Created Apr 2024 View on GitHub

Stars
272
<1% of modelscope's stars
Rank
#213,696
of 847,086 repos, top 26%
In C
#8,395
of 32,546 repos, top 26%

Among 847,086 repos

Compare with

250–400 stars: 77,108 repos, including dash-infer

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #213,035
Next milestone
+84 stars to reach the top 20%
Popular
One of 488,402 repos with 100+ stars
Yearly average
104 stars a year since Apr 2024

Stars counted Recounted daily Next count around