MegEngine/InferLLM

a lightweight LLM model inference framework

by 旷视天元 MegEngine C++ Apache-2.0 licence 94 forks Created May 2023 View on GitHub

Stars
752
8% of MegEngine's stars
Rank
#86,453
of 847,083 repos, top 11%
In C++
#4,567
of 45,199 repos, top 11%

Among 847,083 repos

Compare with

630–1k stars: 35,500 repos, including InferLLM

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #86,351
Next milestone
+17 stars to reach the top 10%
Popular
One of 488,395 repos with 100+ stars
Yearly average
213 stars a year since May 2023

Stars counted Recounted daily Next count around