niieani/gpt-tokenizer

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.

by Bazyli Brzóska TypeScript MIT licence 66 forks Created Mar 2023 View on GitHub

Stars
860
7% of niieani's stars
Rank
#76,498
of 851,984 repos, top 9%
In TypeScript
#7,474
of 62,469 repos, top 12%

Among 851,984 repos

Compare with

630–1k stars: 35,594 repos, including gpt-tokenizer

Stars along the bottom, and repos in each band on a log scale

Quick stats

Next rank
+1 star to reach #76,432
Next milestone
+6,360 stars to reach the top 1%
Popular
One of 490,652 repos with 100+ stars
Yearly average
236 stars a year since Mar 2023

Stars counted Recounted daily Next count around