headroomlabs-ai / headroom

Compresses tool outputs, logs, files, RAG chunks and conversation history before they reach an LLM, as a library, proxy, or MCP server.

vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

BerriAI / litellm

Python SDK and self-hostable proxy server that calls 100+ LLM providers through a unified OpenAI-compatible API.