tashfeenahmed / freellmapi

Self-hosted OpenAI-compatible proxy that routes requests across free-tier LLM providers with failover and encrypted key storage.

vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

BerriAI / litellm

Python SDK and self-hostable proxy server that calls 100+ LLM providers through a unified OpenAI-compatible API.

QuantumNous / new-api

Self-hosted AI gateway that exposes one API to clients while routing requests to multiple upstream model providers.

mudler / LocalAI

Open-source local AI engine that runs LLMs, vision, voice, image, and video models behind OpenAI-compatible APIs on CPU or GPU.

iFurySt / open-computer-use

An open-source computer-use service exposed as an MCP server, letting AI agents control macOS, Linux, and Windows desktops.

ddalcu / mlx-serve

Native macOS and Apple Silicon inference server exposing OpenAI, Anthropic and Ollama APIs, with a Swift app, written in Zig.

Mag1cFall / AIStudio2API

Go proxy that converts Google AI Studio web access into OpenAI, Anthropic, and Gemini compatible APIs with multi-account support.

techjarves / Uncensored-Local-AI-Multiplatform

A Flutter app that runs GGUF language models fully offline on Android, iOS, and desktop, with an optional local OpenAI-compatible API.

cogwheel0 / conduit

Native iOS and Android client for Open WebUI, OpenAI-compatible endpoints, Ollama, and Hermes agents, built in Flutter.