mlc-ai/ tokenizers-cpp
Universal cross-platform tokenizers binding to HF and sentencepiece
by mlc-ai C++ Apache-2.0 licence 131 forks Created May 2023 View on GitHub
- Stars
- 514
- 1% of mlc-ai's stars
- Rank
- #122,423
- of 847,086 repos, top 15%
- In C++
- #6,457
- of 45,203 repos, top 15%
Among 847,086 repos
400–630 stars: 51,365 repos, including tokenizers-cpp
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #122,201
- Next milestone
- +255 stars to reach the top 10%
- Popular
- One of 488,402 repos with 100+ stars
- Yearly average
- 147 stars a year since May 2023