tashfeenahmed / freellmapi

Self-hosted OpenAI-compatible proxy that routes requests across free-tier LLM providers with failover and encrypted key storage.

vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

BerriAI / litellm

Python SDK and self-hostable proxy server that calls 100+ LLM providers through a unified OpenAI-compatible API.

QuantumNous / new-api

Self-hosted AI gateway that exposes one API to clients while routing requests to multiple upstream model providers.

mudler / LocalAI

Open-source local AI engine that runs LLMs, vision, voice, image, and video models behind OpenAI-compatible APIs on CPU or GPU.

techjarves / Uncensored-Local-AI-Multiplatform

A Flutter app that runs GGUF language models fully offline on Android, iOS, and desktop, with an optional local OpenAI-compatible API.

cogwheel0 / conduit

Native iOS and Android client for Open WebUI, OpenAI-compatible endpoints, Ollama, and Hermes agents, built in Flutter.