📈 GH Trending Explorer 🎲 Surprise me

Search: llm-gateway · clear

cheaper-inference / OmniRoute

Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors

▲ ~973/7d ★ 80k TypeScript today
respanai / respan-gateway

One endpoint for every LLM vendor. Any SDK, any model, any tool. One Rust binary.

▲ ~350/7d ★ 144 Rust today
BerriAI / litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

▲ ~182/7d ★ 62k Python today
eliasbiondo / antirion

⚡ The fastest open-source AI gateway — one Rust binary with a built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.

▲ 148/7d ★ 146 Rust 4d ago
decolua / 9router

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

▲ ~105/7d ★ 31k JavaScript 7d ago
maximhq / bifrost

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

▲ ~77/7d ★ 9.0k Go 1d ago
tbphp / gpt-load

Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

▲ ~42/7d ★ 7.2k Go 1d ago
LAGcomcom / zen-gate

把 OpenCode Zen 免费模型装进你所有的 AI Agent —— Windows 托盘网关,OpenAI/Anthropic 兼容,自动适配 10+ Agent,限流自动切换

▲ ~35/7d ★ 223 Go 1d ago
mozilla-ai / otari

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

▲ ~28/7d ★ 719 Python 1d ago
zexadev / gemini-web2api-go

Gemini web → OpenAI-compatible API, self-hosted, no API key. Reverse-proxies gemini.google.com into /v1/chat/completions: single Go binary, Chrome TLS fingerprint, cookie pool with auto-renewal, proxy pool, admin dashboard, SQLite/MySQL/PG, image & video generation · 把 Gemini 网页反代成 OpenAI 兼容 API

▲ ~21/7d ★ 669 Go 3d ago
higress-group / HiRoute

Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.

▲ ~21/7d ★ 316 Rust today
theopenco / llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

▲ ~14/7d ★ 1.7k TypeScript today
Nexilume-AI / nexus-cloud

Nexus — execution infrastructure for AI agents. Host agents in the cloud or behind NAT; let users attach and authorize their own computers and Android phones. Deploy once, work across devices. Python SDK · MCP · Shared run context · Browser, terminal and files · Built-in chat UI · Model routing.

▲ ~14/7d ★ 59 Python today
Kong / kong

🦍 The API and AI Gateway

▲ ~7/7d ★ 44k Lua 🔥 4d ago
bestruirui / octopus

One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

▲ ~7/7d ★ 2.7k TypeScript 9d ago
ENTERPILOT / GoModel

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

▲ ~7/7d ★ 1.3k Go 1d ago
0xgetz / opencode-free-9router

Expose the OpenCode Zen free-tier models as one OpenAI-compatible provider for 9Router. No OpenCode account required. Zero dependencies.

▲ ~7/7d ★ 46 JavaScript 5d ago
0xgetz / tokenmix-bulk-creator

Bulk-provision TokenMix accounts with disposable temp-mail.io inboxes and auto-generate API keys with random names. Turnstile-aware, Playwright-driven, JSON/CSV output.

▲ ~7/7d ★ 33 Python 17d ago
TykTechnologies / tyk

Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)

▲ ~0/7d ★ 11k Go 1d ago
katanemo / plano

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

▲ ~0/7d ★ 7.1k Rust 15d ago
Paritok-official / paritok-4b-v1

Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturated sessions, and fits ~3× more turns in the same context window. Powered by our open-source code-native 4B model. Drop-in for Claude Code, Cursor, Codex, OpenHands, and any BASE_URL agent.

▲ ~0/7d ★ 1.5k Python 16d ago
ThinkWatchProject / ThinkWatch

Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.

▲ ~0/7d ★ 819 Rust 1d ago
NadirRouter / NadirClaw

Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.

▲ ~0/7d ★ 661 Python 1d ago
apache / casbin-gateway

See what every AI coding agent on your machine is doing, and whether the API behind it is the one you paid for. Claude Code, Codex, Cursor, Gemini CLI and more: one endpoint for 44 model vendors, A–F API authenticity grading, per-agent permissions, usage and prompt records.

▲ ~0/7d ★ 643 Go 2d ago
Fast-Editor / Lynkr

Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

▲ ~0/7d ★ 636 JavaScript 2d ago
apimart001a / llm-gateway-comparison

LLM gateway comparison: self-hosted and managed AI API gateways compared on protocol compatibility, billing units, timeout and retry semantics, idempotency, quotas and observability.

▲ ~0/7d ★ 155 Python 1mo ago
ThinkWatchProject / ThinkWatch-Lite

Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.

▲ ~0/7d ★ 119 TypeScript today
azrtydxb / Fastllm-proxy

The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.

▲ ~0/7d ★ 106 Rust today
ShadowSafin / Synapass

AI inference gateway and control plane for multi-provider routing, policies, caching, tools, and observability.

▲ ~0/7d ★ 105 Go 4d ago
apimartrvgd4 / llm-gateway-sdk-node

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 56 Python today
apimartgilk6eh / llm-gateway-cheatsheet

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 55 20d ago
apimartng43u96 / llm-gateway-self-hosted

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 55 Python today
WncFht / devin2api

Devin upstream → OpenAI Responses / Anthropic Messages compatible API proxy

▲ ~0/7d ★ 54 Go 5d ago
apimartq1apm / llm-gateway-migration-kit

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 54 Python today
apimartdacui9oa / llm-gateway-directory

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 53 Python 10d ago
apimarthxrsd / llm-gateway-pricing-guide

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 52 Python 10d ago
apimartowlbj93 / llm-gateway-pricing-guide

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 52 Python 10d ago
apimarty6wrp1 / llm-gateway-benchmark

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 51 Python today
apimarty6wrp1 / llm-gateway-alternatives

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 51 Python today
qiantingwl / xinyueai

开源、可自托管的 AI 创作与模型管理平台:多模型对话、模型网关、无限画布、图片/视频/商品视觉、办公输出与运营后台(Vue 3 + NestJS)

▲ ~0/7d ★ 50 TypeScript 11d ago
apimarthxrsd / llm-gateway-quickstart

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 49 Python today
apimartzw / llm-gateway-benchmark

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 48 Python today
apimartzw / llm-gateway-alternatives

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 47 Python today
apimartop / llm-gateway-no-vpn

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 47 Python today
webkubor / dsh-llm-hub

DeepSeek Harness 模型管理插件:网关健康探测、模型目录发现与余额/配额展示。DSH plugin for LLM gateway health, model discovery and account balance monitoring.

▲ ~0/7d ★ 46 JavaScript 4d ago
apimartq1apm / llm-gateway-migration-guide

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 46 Python 10d ago
apimartemk4bsg0 / llm-gateway-migration-kit

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 45 Python today
apimartlpehh / llm-gateway-guide

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 45 Python 10d ago
apimartv3cm / llm-gateway-bypass-guide

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 44 Python today
apimartpx0d7edg8 / llm-gateway-self-hosted

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 44 Python today
apimartemk4bsg0 / llm-gateway-migration-guide

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 44 Python 10d ago
vayungodara / cliproxy-rs

Rust rewrite of CLIProxyAPI: drop-in compatible proxy for Claude, Codex, Gemini and OpenAI-compatible providers

▲ ~0/7d ★ 44 Rust today
apimartlpehh / llm-gateway-free-tier

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 43 Python 10d ago
apimartjgp76 / llm-gateway-free-tier

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 42 Python 10d ago
apimartv0g / llm-gateway-bypass-guide

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 42 Python today
apimartu2yye / llm-gateway-cost-guide

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 41 Python 10d ago
apimartnv / llm-gateway-sdk-python

AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.

▲ ~0/7d ★ 40 Python 10d ago
398894496-arch / TDHarness-coding

Self-hosted AI workbench for a company LAN. One command on a Windows server sets up login, roster, model gateway, company disk and knowledge base; each employee's agent works on their own PC while model keys stay on the server. 一键安装的局域网 AI 工作台。

▲ ~0/7d ★ 37 JavaScript 3d ago
Yachiyo-5i / xLyra

Multi-site AI gateway and control plane — unified routing across OpenAI, Anthropic, Codex, Grok, Gemini and more, with protocol conversion, OAuth orchestration, cost tracking, and real-time traffic observability

▲ ~0/7d ★ 36 Go today

Load more →