google / sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.

niedev / RTranslator

Open source real-time translation app for Android that runs locally

actual-computer / toks

exact tokenizers ids, as fast as the hardware allows