sail-sg/regmix

[ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)

by Sea AI Lab Jupyter Notebook MIT licence 19 forks Created Jun 2024 View on GitHub

Stars
220
1% of sail-sg's stars
Rank
#256,060
of 852,204 repos, top 31%
In Jupyter Notebook
#5,622
of 21,671 repos, top 26%

Among 852,204 repos

Compare with

160–250 stars: 104,127 repos, including regmix

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #255,167
Next milestone
+1 star to reach the top 30%
Popular
One of 490,852 repos with 100+ stars
Yearly average
91 stars a year since Jun 2024

Stars counted Recounted daily Next count around