kootenpv/tok

Fast and customizable tokenization

by Pascal van Kooten Python 9 forks Created Jul 2019 View on GitHub

Stars
67
1% of kootenpv's stars
Rank
#667,126
of 852,204 repos, top 79%
In Python
#135,040
of 173,304 repos, top 78%

Among 852,204 repos

Compare with

63–100 stars: 217,630 repos, including tok

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #659,120
Next milestone
+11 stars to reach the top 70%
Yearly average
9 stars a year since Jul 2019

Stars counted Recounted daily Next count around