BerriAI / litellm
git clone https://github.com/BerriAI/litellm.git
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
62k
★ total
13k
forks · 5.5k open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguagePython
License—
Created2023-07-27 (3y ago)
Last pushtoday
OwnerOrganization
GitHub topics
ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyrustrust-aivertex-ai
Links
- GitHub: github.com/BerriAI/litellm
- Homepage: https://docs.litellm.ai/docs/
- Releases · Issues · Hacker News mentions