spcl/QuaRot

Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.

by SPCL Python Apache-2.0 licence 78 forks Created Mar 2024 View on GitHub

Stars
541
7% of spcl's stars
Rank
#116,874
of 847,083 repos, top 14%
In Python
#21,725
of 172,210 repos, top 13%

Among 847,083 repos

Compare with

400–630 stars: 51,358 repos, including QuaRot

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #116,673
Next milestone
+228 stars to reach the top 10%
Popular
One of 488,395 repos with 100+ stars
Yearly average
207 stars a year since Mar 2024

Stars counted Recounted daily Next count around