mlc-ai/tokenizers-cpp

Universal cross-platform tokenizers binding to HF and sentencepiece

by mlc-ai C++ Apache-2.0 licence 131 forks Created May 2023 View on GitHub

Stars
514
1% of mlc-ai's stars
Rank
#122,423
of 847,086 repos, top 15%
In C++
#6,457
of 45,203 repos, top 15%

Among 847,086 repos

Compare with

400–630 stars: 51,365 repos, including tokenizers-cpp

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #122,201
Next milestone
+255 stars to reach the top 10%
Popular
One of 488,402 repos with 100+ stars
Yearly average
147 stars a year since May 2023

Stars counted Recounted daily Next count around