ollama / ollama

Runs open-weight LLMs such as Gemma, Qwen, DeepSeek, and gpt-oss locally or in the cloud, with a CLI, REST API, and Python and JavaScript libraries.

mudler / LocalAI

Open-source local AI engine that runs LLMs, vision, voice, image, and video models behind OpenAI-compatible APIs on CPU or GPU.

QuantumNous / new-api

Self-hosted AI gateway that exposes one API to clients while routing requests to multiple upstream model providers.

google / agentmesh

Agent Mesh is a private network that lets AI agents publish and discover tools and models, with verifiable node identities.

google / ax

Declarative Kubernetes-style orchestrator that runs sandboxed autonomous agent tasks on Agent Substrate, with workspaces and model specs.