Runs open-weight LLMs such as Gemma, Qwen, DeepSeek, and gpt-oss locally or in the cloud, with a CLI, REST API, and Python and JavaScript libraries.
Self-hosted AI gateway that exposes one API to clients while routing requests to multiple upstream model providers.
Native macOS and Apple Silicon inference server exposing OpenAI, Anthropic and Ollama APIs, with a Swift app, written in Zig.