bytedance/1d-tokenizer

This repo contains the code for 1D tokenizer and generator

by Bytedance Inc. Jupyter Notebook Apache-2.0 licence 69 forks Created Jun 2024 View on GitHub

Stars
1,177
<1% of bytedance's stars
Rank
#57,564
of 852,204 repos, top 7%
In Jupyter Notebook
#1,146
of 21,671 repos, top 6%

Among 852,204 repos

Compare with

1k–1.6k stars: 23,672 repos, including 1d-tokenizer

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #57,529
Next milestone
+6,034 stars to reach the top 1%
Popular
One of 66,543 repos with 1k+ stars
Yearly average
492 stars a year since Jun 2024

Stars counted Recounted daily Next count around