tbphp / gpt-load
git clone https://github.com/tbphp/gpt-load.git
v2.0.0-rc.53 · 1d ago
Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
+6
stars, 24h · #2,397
+~42
stars, 7 days · #2,962
+~180
stars, 30 days · #2,929
7.2k
★ total · +1% this week
795
forks · 12 open issues
Star history (as recorded here)
LanguageGo
LicenseMIT
Created2025-06-06 (1y ago)
Last pushtoday
Watchers18
OwnerUser
GitHub topics
ai-gatewayanthropicapi-gatewayclaudeclaude-codecodexgeminigingogolangllmllm-gatewayload-balanceropenaiself-hosted
Links
- GitHub: github.com/tbphp/gpt-load
- Homepage: https://www.gpt-load.com
- Releases · Issues · Hacker News mentions
README excerpt
# GPT-Load **A self-hosted AI gateway for multi-channel, multi-credential setups** API keys, subscription accounts, traffic scheduling, failure handling, request logs, and usage accounting — behind a single entry point. English · 中文 · 日本語 | Official Website --- ## Sponsors Become a sponsor Sponsor details (collapsible) Thanks to Modelflare for sponsoring this project! Modelflare: Full strength, stable, nothing watered down. Global SOTA models at a lower cost. Operated by US-based Havenbyte LLC, Modelflare supports GPT, Claude, Gemini, Grok, and other leading models through common compatible protocols, plus 40+ image and video models. **Cache compensation** is a highlight: selected OpenAI groups (price-first, stable, and premium) guarantee daily cache hit rates of 65%, 75%, or 85%, and if eligible requests fall short, Modelflare refunds the difference, visible on the usage dashboard after settlement. **Special offers**: a single top-up of US$20 unlocks the GPT discount group at a 0.015x price multiplier, and a single top-up of US$50 unlocks the Claude discount group at a 0.03x multiplier. Register via this exclusive link to get started. --- OfoxAI: Text, image, and video AI in one platform OfoxAI is a unified AI API platform bringing together text, image, and video models from multiple providers. With OpenAI-compatible endpoints and native Anthropic and Gemini interfaces, developers can access models for AI applications, agents, and content creation through one platform. Explore OfoxAI models and APIs → PackyCode Access leading AI models through PackyCode with one API endpoint and one API key. Enjoy fast, reliable access with automatic failover and dedicated high-speed routes for Codex and Claude Code. Get started with $1 in free credits, a discount on your first top-up, and savings of up to 80% on eligible routes. Pay in RMB with no currency conversion markups or extra top-up fees. Sign up through the link and start building today. Protect and accelerate websites and APIs, serving users in mainland China and around the world, and extend acceleration and security capabilities to native/mobile apps through a client SDK — self-built private-deployment CDN | subscription-based high-protection CDN | an independently controllable, flexibly composable CDN network. Thanks to APIMart for sponsoring this project! APIMart is a low-cost API platform for AI image & video generation — GPT-Image-2 from $0.006/image, 160+ images per dollar. One async API covers both image and video: submit a task, get an ID, fetch results via polling or callback. Batch tens of thousands of images without timeouts, switch models without changing code. Pay-as-you-go with no monthly fee — sign up here to get started. ## Why GPT-Load Your application only needs one base URL and one AccessKey. Providers, accounts, credentials, models, and routing policy are all configured in the management UI. - **One gateway, native protocols** — Manage official APIs, cloud platforms, mo