BerriAI / litellm

Python SDK and self-hostable proxy server that calls 100+ LLM providers through a unified OpenAI-compatible API.

QuantumNous / new-api

Self-hosted AI gateway that exposes one API to clients while routing requests to multiple upstream model providers.

agentgateway / agentgateway

Open source proxy that routes and secures agent-to-LLM, agent-to-tool, and agent-to-agent traffic using MCP and A2A protocols.

apache / apisix

Apache APISIX is a dynamic, high-performance API gateway that also works as an AI gateway and Kubernetes ingress controller.