ddalcu / mlx-serve

# MLX-Serve
Run open models on your Mac: chat, coding agents, images, video, music, speech and 3D. One native app and one local server that speaks the OpenAI, Anthropic and Ollama APIs. It runs offline, needs no Python and no account, and it's MIT licensed.
**Download for Mac** · Homebrew · iPhone · Linux · mlxserve.com · 简体中文
## Install
**The app.** Download MLX-Serve, drag it to Applications and open it. It needs macOS 26.2 or later on Apple Silicon, suggests a model that fits your Mac, and updates itself.
**Homebrew.**
 [code] 
**The terminal**, if you know Ollama:
 [code] 
The server listens on `http://localhost:11234`. Point any OpenAI, Anthropic or Ollama client at it, or open that address in a browser for the built-in web console.
### iPhone
MLX-Serve puts the same engine on your iPhone: chat with Gemma 4, clone your voice, and make pictures and music, all on the phone and offline. It needs an A17 Pro-class iPhone or newer with iOS 26.
### Linux and Windows
Every release has Linux downloads for NVIDIA GPUs: x64 for RTX 20 to 50 cards, arm64 for DGX Spark, GH200 and Jetson Thor. On Windows with an NVIDIA card, one script builds it. Details are in docs/building.md.
## What it does
- **Coding agents on a local model.** `mlx-serve launch claude` starts Claude Code against your Mac, set up with the model's real context window. Codex, OpenCode, pi, Grok and others work the same way. Integrations
- **Pictures, video, music, speech and 3D.** FLUX.2, Qwen-Image, Krea, MOSS-Image, LTX-Video, MiniMax-H3, ACE-Step, YuE2, Qwen3-TTS with voice cloning, and Hunyuan3D, in the app or over HTTP. The app
- **Transcripts and meeting notes.** Speech to text in 30 languages, with word timings and who said what. The menu bar records a call and writes the notes. API
- **Models bigger than your Mac.** GLM-5.3-Flash, MiMo-V2.6-Flash and DeepSeek-V4.1-Flash run on a 128 GB Mac by reading their experts from the SSD. Two Macs on a Thunderbolt 5 cable can run one model together, and Macs on your network can use each other's models. CLI · FAQ
- **An assistant that lives on your Mac.** Chat with your documents, talk to it hands-free, give agents a sandboxed shell and MCP tools, or schedule tasks in plain English. The app
- **The APIs your tools already use.** OpenAI chat, completions and Responses, Anthropic Messages and Ollama, all on one port, with streaming, tool calls, JSON schemas, vision and reasoning. API
## What can my Mac run?
The app suggests a first model for your Mac's memory:
| Memory | Suggested model |
|---|---|
| 16 GB | Gemma 4 E4B |
| 18–24 GB | Gemma 4 12B |
| 32 GB | Qwen 3.8 27B |
| 36 GB | Qwen 3.8 27B 6-bit |
| 48–64 GB | Qwen 3.8 27B 8-bit |
| 96 GB and up | Qwen3.8-Flash-Next (125B, about 6B active per token) |
| 128 GB | Also GLM-5.3-Flash, MiMo-V2.6-Flash and DeepSeek-V4.1-Flash, streamed from the SSD |
| 256 GB | Also GLM-5.3 (744B), streamed from the SSD |
Thousands more run too: any MLX model with a supported architecture, and any GGUF. The