ollama / ollama

Runs open-weight LLMs such as Gemma, Qwen, DeepSeek, and gpt-oss locally or in the cloud, with a CLI, REST API, and Python and JavaScript libraries.

vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

corrinehu / dsh-workbuddy-connect

Connects models from the logged-in WorkBuddy desktop app into DeepSeek Harness as a plugin, with no extra configuration.

QuantumNous / new-api

Self-hosted AI gateway that exposes one API to clients while routing requests to multiple upstream model providers.

ddalcu / mlx-serve

Native macOS and Apple Silicon inference server exposing OpenAI, Anthropic and Ollama APIs, with a Swift app, written in Zig.

rikkahub / rikkahub

Native Android chat client for LLMs that switches between multiple AI providers within conversations.