bytedance/ 1d-tokenizer
This repo contains the code for 1D tokenizer and generator
by Bytedance Inc. Jupyter Notebook Apache-2.0 licence 69 forks Created Jun 2024 View on GitHub
- Stars
- 1,177
- <1% of bytedance's stars
- Rank
- #57,564
- of 852,204 repos, top 7%
- In Jupyter Notebook
- #1,146
- of 21,671 repos, top 6%
Among 852,204 repos
1k–1.6k stars: 23,672 repos, including 1d-tokenizer
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #57,529
- Next milestone
- +6,034 stars to reach the top 1%
- Popular
- One of 66,543 repos with 1k+ stars
- Yearly average
- 492 stars a year since Jun 2024