NVIDIA/ TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs....
by NVIDIA Corporation Python Other licence 2,924 forks Created Aug 2023 View on GitHub
- Stars
- 15,051
- 3% of NVIDIA's stars
- Rank
- #3,435
- of 847,083 repos, top 0.4%
- Down 3 places this week
- In Python
- #656
- of 172,210 repos, top 0.4%
Among 847,083 repos
10k–16k stars: 2,591 repos, including TensorRT-LLM
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #3,434
- Next milestone
- +23,094 stars to reach the top 0.1%
- Popular
- One of 5,747 repos with 10k+ stars
- Yearly average
- 4,649 stars a year since Aug 2023