Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.
Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows, automation, and chat apps
Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, optional readalong web UI
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
FuXi is a fast, self-contained AI coding agent that lives in your terminal — edit code, run commands, and drive tools, with cost-aware routing across LLM providers.
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.
Translate full-length books and documents with Ollama, OpenAI-compatible, Gemini, Mistral, DeepSeek, Poe or OpenRouter. Preserves formatting. Resumes where you left off. No file size limits.
Private local AI assistant for your desktop. Voice and text chat, personal memory, dictation and MCP tools. Runs offline with Ollama or OpenAI-compatible servers on macOS, Windows and Linux.
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Open-source agent platform for Global × China enterprises — wire every system through one agent core. Self-hosted, any LLM.
Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter
LightAgent: Lightweight Python framework for OpenAI-compatible agents with tools, memory, guardrails, tracing, lifecycle hooks, multi-agent collaboration, and workflows.
Govern, Observe, Direct - a real-time control room for agent societies
Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.
[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
把 Muse(muse.ai) 逆向封装为 OpenAI 兼容接口,支持对话、文生图、文生视频/图生视频、多账号池轮转与 48h 自动续期。OpenAI-compatible API for Muse.ai with Chat, Image & Video generation.
把 Codex imagegen 的工作流与提示词库带到任意智能体;支持 npm/pnpm 一键安装、配套 skill、独立 API 与 Qwen-Image 兼容网关。
Hermes Agent TTS and STT plugin for AllModels speech models and voices.
A transparent, OpenAI-compatible agent runtime built from first principles.
OpenRouter alternatives: AI API aggregator and gateway options compared on model coverage, billing units, free tiers, OpenAI compatibility, rate limits and migration effort.
LLM gateway comparison: self-hosted and managed AI API gateways compared on protocol compatibility, billing units, timeout and retry semantics, idempotency, quotas and observability.
AI API aggregator companion: machine-readable catalog of 300+ models behind one key and one base URL, with routing patterns, cost accounting, OpenAI SDK and curl examples.
AI coding agent with one Python core and three front-ends — headless CLI, Textual TUI, and an Electron desktop. Works with any OpenAI-compatible API, with risk-tiered permissions, event-sourced replayable sessions, and a fail-closed OS-level sandbox.
OpenAI-compatible async gateway for muse.ai with pluggable drivers (mock / browser-CDP / http)
High-performance OpenAI-compatible API gateway and bridge for muse.ai personal AI agents, ready for 9Router multi-model integration.
Complete, end-to-end framework and high-performance OpenAI-compatible gateway for the Qoder ecosystem.
Claude Opus 5 API (claude-opus-5): model id, per-million-token pricing, cache write and cache read rates, streaming and Anthropic-style requests through an OpenAI-compatible gateway.
Unified AI API model catalog: machine-readable JSON for 300+ models behind one OpenAI-compatible API, with modality, billing unit, per-image, per-second and per-token pricing and doc links.
OpenAI-compatible API migration kit: drop-in /v1/images/generations and chat examples, a compatibility matrix, rollback switches and a checklist for moving workloads between AI API gateways.
GPT-5.5 API (gpt-5.5 / gpt-5.5-pro): model ids, per-million-token pricing, context limits, streaming, tool calling and OpenAI-compatible base URL examples.
AI API proxy SDK for Python: retry with idempotency keys, rate-limit backoff, task polling, cost accounting and typed errors for OpenAI-compatible AI API gateways.
An open-source virtual AI Infra team that discovers, benchmarks, and safely upgrades local LLM inference—with independent quality gates, a stable OpenAI-compatible API, and automatic rollback.
wan-3.0-video API (wan3.0video / wan 3.0 video): 480P $0.0329; 720P $0.0658; default $0.1315. Model id, api settings, curl and Python examples over an OpenAI-compatible gateway, $1
flux-2 API (flux2 / flux 2): 1MP $0.024; 2MP $0.036; 3MP $0.048. Model id, prompts settings, curl and Python examples over an OpenAI-compatible gateway, $1 minimum top-up.
hailuo-2.3 API (hailuo2.3 / hailuo 2.3): default $0.0248; 1080P $0.0424. Model id, gateway settings, curl and Python examples over an OpenAI-compatible gateway, $1 minimum top-up.
kling-3 API (kling3 / kling 3): default $0.0672; pro $0.0896; sound $0.1008. Model id, prompts settings, curl and Python examples over an OpenAI-compatible gateway, $1 minimum top-
seedream-5.0 API (seedream5.0 / seedream 5.0): 1K-layer $0.0146; 1K $0.0293; 2K-layer $0.0293. Model id, prompts settings, curl and Python examples over an OpenAI-compatible gatewa
veo-3.1 API (veo3.1 / veo 3.1): default $0.07; extend $0.07; 4K $0.57. Model id, api settings, curl and Python examples over an OpenAI-compatible gateway, $1 minimum top-up.
qwen-image-3.0 API (qwenimage3.0 / qwen image 3.0): default $0.0206; 1K $0.0206; 2K $0.0206. Model id, prompts settings, curl and Python examples over an OpenAI-compatible gateway,
midjourney API (midjourney / midjourney): default $0.045; imagine $0.045; imagine-niji6 $0.045. Model id, prompts settings, curl and Python examples over an OpenAI-compatible gatew
kling-3 API (kling3 / kling 3): default $0.0672; pro $0.0896; sound $0.1008. Model id, api settings, curl and Python examples over an OpenAI-compatible gateway, $1 minimum top-up.
gemini-3-pro-image-preview API (nanobananapro / gemini 3 pro image preview): 4K $0.04 per image; default $0.03. Model id, 4k settings, curl and Python examples over an OpenAI-compa
nano-banana-pro API (nanobananapro / nano banana pro): default $0.03; 4K $0.04. Model id, gateway settings, curl and Python examples over an OpenAI-compatible gateway, $1 minimum t
qwen-image-3.0 API (qwenimage3.0 / qwen image 3.0): default $0.0206; 1K $0.0206; 2K $0.0206. Model id, gateway settings, curl and Python examples over an OpenAI-compatible gateway,
hailuo-2.3 API (hailuo2.3 / hailuo 2.3): default $0.0248; 1080P $0.0424. Model id, api settings, curl and Python examples over an OpenAI-compatible gateway, $1 minimum top-up.
veo-3.1 API (veo3.1 / veo 3.1): default $0.07; extend $0.07; 4K $0.57. Model id, prompts settings, curl and Python examples over an OpenAI-compatible gateway, $1 minimum top-up.
A local OpenAI-compatible bridge to the free DeepSeek web chat, which you can plug into opencode as a regular model provider and use as a full-fledged agent (reading/editing files, bash, code search, etc.) — with no API key and no payment.
seedance-2.5 API (seedance2.5 / seedance 2.5): 1080P costs $0.3849 per second; 720P $0.216; 480P $0.0961. Model id, 1080p settings, curl and Python examples over an OpenAI-compatib
wan-3.0-video API (wan3.0video / wan 3.0 video): 480P $0.0329; 720P $0.0658; default $0.1315. Model id, gateway settings, curl and Python examples over an OpenAI-compatible gateway
seedance-2.0-mini API (seedance2.0mini / seedance 2.0 mini): 480P $0.01056 per second; 720P $0.02288. Model id, api settings, curl and Python examples over an OpenAI-compatible gat
Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI compatible.
seedance-2.5 API (seedance2.5 / seedance 2.5): from $0.0961 per second (480P) through one gateway key. Model id, gateway settings, curl and Python examples over an OpenAI-compatibl
seedance-2.0 API (seedance2.0 / seedance 2.0): 480P-input $0.04; 480P $0.066; 720P-input $0.0858. Model id, 4k settings, curl and Python examples over an OpenAI-compatible gateway,
seedance-2.5 API (seedance2.5 / seedance 2.5): every recipe runs from $0.0961 per second (480P). Model id, prompts settings, curl and Python examples over an OpenAI-compatible gate
Trae CN model relay: OpenAI-compatible Chat/Responses API with tool calling, reasoning effort, multi-account polling and checkin
grok-imagine-2.0 API (grokimagine2.0 / grok imagine 2.0): upload-image $0; default $0.015; region-edit $0.015. Model id, 2k settings, curl and Python examples over an OpenAI-compat
AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.
Nano Banana (official) API (`gemini-2.5-flash-image-preview-official`): model id, pricing, parameters and copy-paste examples for the OpenAI-compatible APIMart endpoint.