Compresses tool outputs, logs, files, RAG chunks and conversation history before they reach an LLM, as a library, proxy, or MCP server.
Knowhere extracts, parses, and outputs structured chunks ready for AI Agents and RAG.
A tool to select chunks from Minecraft worlds for deletion or export.
A high-performance C# based Archetype & Chunks Entity Component System (ECS) with optional multithreading.
Whisper-Flow is a framework designed to enable real-time transcription of audio content using OpenAI’s Whisper model. Rather than processing entire files after upload (“batch mode”), Whisper-Flow accepts a continuous stream of audio chunks and produces incremental transcripts immediately.
Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.
A robust, strictly-typed Node.js and Browser library for parsing office files into a rich Abstract Syntax Tree (AST) and generating high-fidelity output in multiple formats. Parses: docx · pptx · xlsx · odt · odp · ods · pdf · rtf · csv · md · html. Generates: Markdown · HTML · CSV · RTF · PDF · Plain Text · RAG Chunks
Open, structured Indian primary law: 32.5M judgment chunks from the Supreme Court and all 25 High Courts, 1.1M legislation provisions, and the scrapers that build it. CC BY 4.0.
A Go library for splitting long text into retrieval-sized chunks for RAG.
Record the chunks you actually see on a multiplayer Minecraft server and rebuild them as a single-player world. Client-only Fabric mod for 26.2 plus a CLI.
Pre-generates chunks, quickly, efficiently, and safely.