eliasbiondo / antirion
⚡ The fastest open-source AI gateway — one Rust binary with a built-in console to route, secure, budget and observe every LLM call across OpenAI, Anthropic, Gemini, Bedrock and more.
eliasbiondo / antirion
haremank / agent2api
Agent2API — 多提供商本地网关（WorkBuddy/CatPaw/Qoder 等登录态 → OpenAI 兼容 API）。原项目 aimod-cc/agent2api 已停止维护，本仓库为接手维护版本。
openai / codex
Lightweight coding agent that runs in your terminal
1jehuang / jcode
High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows
tailcallhq / forgecode
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
katanemo / plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
Michael-A-Kuykendall / shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
nguyenphutrong / quotio
Stop juggling AI accounts. Quotio is a beautiful native macOS menu bar app that unifies your Claude, Gemini, OpenAI, Qwen, and Antigravity subscriptions – with real-time quota tracking and smart auto-failover for AI coding tools like Claude Code, OpenCode, and Droid.
yynxxxxx / Codex-X
OpenAI Codex 桌面端/CLI 的可视化管理工具，具有Provider/API 切换、会话同步、提示词注入、Skills/MCP 管理、TOML 配置可视化的跨平台工具。
golutra / golutra
Multi-agent AI orchestration platform for automation, workflows, and developer tools. Golutra transforms Codex, Claude Code, and OpenClaw into a unified agent system with parallel execution, task orchestration, long-running workflows, and AI productivity workspace.
NVIDIA-NeMo / Switchyard
Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.
Folkbench / folkbench
AI API 中转站评测排行与切换工具：实测可用率、延迟与价格 · Open-source AI API relay benchmark, rankings & switcher for Claude Code / Codex
64bit / async-openai
Rust library for OpenAI
yomorun / yomo
🦖 Serverless AI Agent Framework with Geo-distributed Edge AI Infra.
shiwenwen / hope-agent
🦭 A cross-device desktop AI agent with memory, autonomous goals, dynamic workflows, and headless deployment | 会记忆、能持续推进目标、会动态编排多 Agent 的跨端桌面 AI 助手，也可服务化常驻 NAS / 云端
Abraxas-365 / langchain-rust
🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust
yym68686 / uni-api
This is a project that unifies the management of LLM APIs. It can call multiple backend services through a unified API interface, convert them to the OpenAI format uniformly, and support load balancing. Currently supported backend services include: OpenAI, Anthropic, DeepBricks, OpenRouter, Gemini, Vertex, etc.
thClaws / thClaws
Open-source AI agent harness in native Rust — GUI, CLI, headless, and webapp from one binary. Multi-provider, MCP, skills, plugins, agent teams.
cubezhao / ai-tools-mng
基于 Tauri 的跨平台桌面应用，用于管理多平台 AI 账号 Augment、Antigravity、Windsurf、Cursor、OpenAI（Codex、API）、Claude Code 与 API 账号，以及订阅、书签管理与邮箱管理。A Tauri-based cross-platform desktop app for managing multi-platform AI accounts (Augment, Antigravity, Windsurf, Cursor, OpenAI Codex/API, Claude Code and API), plus subscriptions, bookmarks, and email management.
xuzhougeng / wisp-science
Open-source, local-first desktop AI research workbench for scientific computing with Python/R, MCP bioinformatics tools, SSH/WSL/GPU runtimes, and OpenAI/Anthropic models.
RockChinQ / free-one-api
LLM 逆向工程接口管理 | 通过标准 OpenAI API 访问 ChatGPT / gpt4free / Bard / Claude / HuggingChat / 通义千问 等 AI 的破解版 || ChatGPT reverse engineering API management | Access all reverse engineered LLM libs by standard OpenAI API format || 免费 ChatGPT Free GPT LLM API | 逆向工程 转 OpenAI API | converts all llm libs to OpenAI API
jeremychone / rust-genai
Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Gemini, DeepSeek, ZAI, OpenRouter, FireworksAI, xAI/Grok, Groq,, ...)
Lampese / codex-switcher
A Desktop Application for Managing Multiple OpenAI Codex CLI Accounts
zyycn / codex-proxy-rs
基于 Rust 的低风控、高性能、自托管多账号透明代理网关
huggingface / llm-ls
LSP server leveraging LLMs for code completion (and more?)
gavamedia / deltafin
Run full Kimi K3 on a single device. And an OpenAI-compatible API server for local chat and coding agents.
NIyueeE / ds-free-api
DeepSeek网页端API代理，支持OpenAI与Anthropic兼容接口 | OpenAI & Anthropic compatible API proxy for DeepSeek web
ThinkWatchProject / ThinkWatch
Self-hosted AI API and MCP gateway for organizations: SSO and RBAC, per-user identity for MCP tool calls, PII redaction and tool-call guards, rate limits, budgets, cost accounting and audit logs.
EricLBuehler / candle-vllm
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
pegainfer-project / pegainfer
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
zavora-ai / adk-rust
Rust Agent Development Kit (ADK-Rust): Build AI agents in Rust with modular components for models, tools, memory, realtime voice, and more. ADK-Rust is a flexible framework for developing AI agents with simplicity and power. Model-agnostic, deployment-agnostic, optimized for frontier AI models. Includes support for real-time voice agents.
Avarok-Cybersecurity / atlas
Pure Rust Inference Engine
smg-project / smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Wangnov / Codex-App-Manager
跨平台官方 Codex 桌面应用的安装 / 增量更新 / 干净卸载管理器，内置国内可达的镜像自更新。Cross-platform installer & updater for the official Codex desktop app — incremental updates, clean uninstall, China-reachable self-update.
CodeZeno / Claude-Code-Usage-Monitor
Windows taskbar widget for Claude Code, Codex, Cursor and more. Track usage limits and reset times. Free and open source.
gglucass / headroom-desktop
Menu Bar App on MacOS and Windows that cuts Claude Code and Codex token costs by ~50%
gakonst / nanocode
SDK for Frontier Embedded Agents.
dragonked2 / alphacode
Free MIT AI coding agent — no API key needed. Built-in free model, or bring Claude, GPT, Gemini, DeepSeek, Ollama +50 more. Swarm mode, 40+ tools, browser & desktop automation, built in Rust.
smart-open / TraeWorkAssistant
AI Work 助手 — Windows/Macos 桌面端 AI 应用多账号管理一体化工具。深度支持 Trae/ WorkBuddy / CodeBuddy / Qoder /豆包 多应用：多账号签到、登录态一键切换、设备标识隔离、账号分组、积分看板、OpenAI 兼容 API 网关。数据全部本地存储。Tauri 2 + React + Rust。
ghuntley / underclass
underclass: an OpenAI-compatible pooling proxy that pins sessions to one account (prompt cache stays warm), cools quota-exhausted subscriptions until their window resets, and fails fast with the earliest Retry-After when the whole pool is dry.
arcships / aimux
Unified LLM access layer in Rust — one API for 325 AI providers. 统一 LLM 服务接入层：一套 API 接入 325 家 AI 服务商。
SailingLoong / LoongPort
cc-switch 中转站的专用增强版（cc-switch for API relay providers），免去配置各种 密钥 endpoint 的烦恼。
truespar / paddock
Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio
BigStrongSun / ccswitchmulti
CCswitch的全面升级，专门优化codex体验。支持官方订阅和第三方模型混用，自动路由，支持v2subagent使用第三方模型
azrtydxb / Fastllm-proxy
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.
datlechin / pitboard
Switch AI coding accounts and see their usage. Command line for macOS, Windows and Linux, app for macOS and Windows. Windows is in beta.
noSugarK / ReaLingo
Realtime speech translation — a desktop simultaneous interpreter for Alibaba Cloud Qwen, OpenAI and Google Gemini
cv-superding / WorkBuddy-Switch2api
WorkBuddy / CodeBuddy 账号切换工具（Tauri + Rust），内置 OpenAI 兼容本地反代：账号池轮转、积分签到监控、托盘常驻。Fork of changexbc/workbuddy-switch
antonellof / frink
Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head against llama.cpp.
BeautyyuYanli / codex-apply-patch
Standalone automatically updated mirror of OpenAI Codex apply-patch
extracurricular-ai / codex-rewind
Unofficial distribution of OpenAI Codex CLI that adds /rewind and /redo — restores your files, not just the conversation. Git-free snapshots that never touch your git state. Tracks upstream releases; installs as `codexr` alongside the official build.
ewsun22 / codex-manager
Local-first desktop control center for OpenAI Codex — sessions, models, tokens, accounts, providers, and AGENTS.md.
linuztx / alter-zero
RAM efficient terminal agent harness for coding, cybersecurity, and automation.
pegainfer-project / pega-omni
OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one GPU.
vayungodara / cliproxy-rs
Rust rewrite of CLIProxyAPI: drop-in compatible proxy for Claude, Codex, Gemini and OpenAI-compatible providers
repotracer / repotracer
A repo investigator for Claude Code and Codex. Offload codebase investigation and get up to 2.7× as much work from the same limits.
IuCC123 / CLIProxyAPI-Rust
Your Claude, ChatGPT and Gemini subscriptions as one fast API. A single Rust binary with OpenAI, Anthropic and Gemini compatible endpoints, WebSockets and a built-in dashboard.
ThisTakou / Converter-Python-to-Rust
AI-powered desktop app for migrating Python projects to Rust. Supports multiple LLM providers (OpenAI, Anthropic, Ollama), includes 300+ library mappings, automatic dependency detection, compile verification, and iterative code refinement. Built with Tauri 2.0.
Mouseww / veil
使用大模型时，隐藏你的密码、token 等敏感信息。适配市面上各种工具，一键安装即可用。 / Hide passwords, tokens and secrets from the model. Works with everyday tools — one-click install.
respanai / respan-gateway
One endpoint for every LLM vendor. Any SDK, any model, any tool. One Rust binary.