niieani/ gpt-tokenizer
The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
by Bazyli Brzóska TypeScript MIT licence 66 forks Created Mar 2023 View on GitHub
- Stars
- 860
- 7% of niieani's stars
- Rank
- #76,498
- of 851,984 repos, top 9%
- In TypeScript
- #7,474
- of 62,469 repos, top 12%
Among 851,984 repos
630–1k stars: 35,594 repos, including gpt-tokenizer
top 50%top 10%top 1%top 0.1%
Stars along the bottom, and repos in each band on a log scale
Quick stats
- Next rank
- +1 star to reach #76,432
- Next milestone
- +6,360 stars to reach the top 1%
- Popular
- One of 490,652 repos with 100+ stars
- Yearly average
- 236 stars a year since Mar 2023