LLM inference server with continuous batching & SSD caching for Apple Silicon β managed from the macOS menu bar
A top for local LLMs: memory, paging, GPU and tokens/s for oMLX, Ollama, llama.cpp, vLLM and more
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4Γ faster than Apple's MLX (mlx-lm) on the same weights.
MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.
Qwen 3.8 27B at 48-65 tok/s on a Mac Studio M4 Max β measured oMLX native-MTP recipe, same-day A/B vs mlx-vlm+MTP sidecar, raw benchmark JSON included
GoMLX: An Accelerated Machine Learning Framework For Go
vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm
Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac Studio, oMLX) over plain 10GbE
Read-only dashboard and rack panel for NVIDIA DGX Spark-class nodes, other NVIDIA GPU Linux machines and Apple Silicon Macs running vLLM, SGLang, TensorFold, llama.cpp, Strata or oMLX
1.0 Beta Β· oMLX 0.6.3rc2 Dual-ANE+CPU Β· Qwen3.8-27B abliterated oQ4e Β· Mac Studio M3 Ultra