benbrandt / text-splitter

git clone https://github.com/benbrandt/text-splitter.git

Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.