headroomlabs-ai / headroom

Compresses tool outputs, logs, files, RAG chunks and conversation history before they reach an LLM, as a library, proxy, or MCP server.

vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.