NVIDIA/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs....

by NVIDIA Corporation Python Other licence 2,924 forks Created Aug 2023 View on GitHub

Stars
15,051
3% of NVIDIA's stars
Rank
#3,435
of 847,083 repos, top 0.4%
Down 3 places this week
In Python
#656
of 172,210 repos, top 0.4%

Among 847,083 repos

Compare with

10k–16k stars: 2,591 repos, including TensorRT-LLM

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #3,434
Next milestone
+23,094 stars to reach the top 0.1%
Popular
One of 5,747 repos with 10k+ stars
Yearly average
4,649 stars a year since Aug 2023

Stars counted Recounted daily Next count around