Lightning-AI/lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

by ⚡️ Lightning AI Python Apache-2.0 licence 516 forks Created Mar 2023 View on GitHub

Stars: 6,080; 10% of Lightning-AI's stars
Rank: #10,391; of 852,204 repos, top 2%
In Python: #1,893; of 173,304 repos, top 2%

Among 852,204 repos

All repos Python

4k–6.3k stars: 6,642 repos, including lit-llama

top 50%top 10%top 1%top 0.1%

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank: +1 star to reach #10,388
Next milestone: +1,131 stars to reach the top 1%
Popular: One of 66,543 repos with 1k+ stars
Yearly average: 1,668 stars a year since Mar 2023