📈 GH Trending Explorer 🎲 Surprise me

← all repos

maximhq / bifrost

git clone https://github.com/maximhq/bifrost.git ent-v2.3.2-base · 2d ago

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

+24
stars, 24h · #1,567
+~149
stars, 7 days · #1,456
+~640
stars, 30 days · #1,300
9.0k
★ total · +2% this week
1.4k
forks · 1.3k open issues

Star history (as recorded here)

2026-10-20 · 8,969 ★ 2026-10-23 · 9,033 ★
LanguageGo
LicenseApache-2.0
Created2025-03-19 (1y ago)
Last pushtoday
Watchers35
OwnerOrganization

GitHub topics

Links

README excerpt
# Bifrost AI Gateway
## The fastest way to build AI applications that never go down
Bifrost is a high-performance AI gateway that unifies access to 23+ providers (OpenAI, Anthropic, AWS Bedrock, Google Vertex, and more) through a single OpenAI-compatible API. Deploy in seconds with zero configuration and get automatic failover, load balancing, semantic caching, and enterprise-grade features.
## Quick Start
**Go from zero to production-ready AI gateway in under a minute.**
**Step 1:** Start Bifrost Gateway
 [code] 
**Step 2:** Configure via Web UI
 [code] 
**Step 3:** Make your first API call
 [code] 
**That's it!** Your AI gateway is running with a web interface for visual configuration, real-time monitoring, and analytics.
**Complete Setup Guides:**
- Gateway Setup - HTTP API deployment
- Go SDK Setup - Direct integration
---
## Enterprise Deployments
Bifrost supports enterprise-grade, private deployments for teams running production AI systems at scale.
In addition to private networking, custom security controls, and governance, enterprise deployments unlock advanced capabilities including adaptive load balancing, clustering, guardrails, MCP gateway, and other features designed for enterprise-grade scale and reliability.
 Explore enterprise capabilities 
---
## Key Features
### Core Infrastructure
- **Unified Interface** - Single OpenAI-compatible API for all providers
- **Multi-Provider Support** - OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure, Cerebras, Cohere, Mistral, Ollama, Groq, and more
- **Automatic Fallbacks** - Seamless failover between providers and models with zero downtime
- **Load Balancing** - Intelligent request distribution across multiple API keys and providers
### Advanced Features
- **Model Context Protocol (MCP)** - Enable AI models to use external tools (filesystem, web search, databases)
- **Semantic Caching** - Intelligent response caching based on semantic similarity to reduce costs and latency
- **Multimodal Support** - Support for text, images, audio, and streaming, all behind a common interface.
- **Custom Plugins** - Extensible middleware architecture for analytics, monitoring, and custom logic
- **Governance** - Usage tracking, rate limiting, and fine-grained access control
### Enterprise & Security
- **Budget Management** - Hierarchical cost control with virtual keys, teams, and customer budgets
- **User Provisioning (OIDC)** - OAuth 2.0 / OIDC login with background directory sync for teams, roles, and business units
- **Observability** - Native Prometheus metrics, distributed tracing, and comprehensive logging
- **Secrets Management** - Secure API key management with environment variables and deployment secrets
### Developer Experience
- **Zero-Config Startup** - Start immediately with dynamic provider configuration
- **Drop-in Replacement** - Replace OpenAI/Anthropic/GenAI APIs with one line of code
- **SDK Integrations** - Native support for popular AI SDKs with zero code changes
- **Configuration Flexi