openai/
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
by OpenAI Python MIT licence 1,676 forks Created Dec 2022 View on GitHub
- Stars
- 19,630
- 2% of openai's stars
- Rank
- #2,410
- of 847,070 repos, top 0.3%
- In Python
- #471
- of 172,206 repos, top 0.3%
Among 847,070 repos
16k–25k stars: 1,432 repos, including tiktoken
top 50%top 10%top 1%top 0.1% 
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +8 stars to reach #2,409
- Next milestone
- +18,515 stars to reach the top 0.1%
- Popular
- One of 5,746 repos with 10k+ stars
- Yearly average
- 4,979 stars a year since Dec 2022