niieani / gpt-tokenizer

git clone https://github.com/niieani/gpt-tokenizer.git

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.