ddalcu / mlx-serve

Native macOS and Apple Silicon inference server exposing OpenAI, Anthropic and Ollama APIs, with a Swift app, written in Zig.

mozilla-ai / llamafile

Packages LLMs and a whisper-based speech-to-text tool into single executable files that run locally without installation.