jzhang38/TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Archived by Zhang Peiyuan Python Apache-2.0 licence 633 forks Created Sept 2023 View on GitHub

Stars
9,004
90% of jzhang38's stars
Rank
#6,555
of 851,984 repos, top 0.8%
In Python
#1,201
of 173,300 repos, top 0.7%

Among 851,984 repos

Compare with

6.3k–10k stars: 4,211 repos, including TinyLlama

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #6,552
Next milestone
+29,168 stars to reach the top 0.1%
Popular
One of 66,569 repos with 1k+ stars
Yearly average
2,813 stars a year since Sept 2023

Stars counted Recounted daily Next count around