raullenchai / Rapid-MLX
git clone https://github.com/raullenchai/Rapid-MLX.git
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
+6
stars, 24h · #5,319
+~40
stars, 7 days · #4,942
+~170
stars, 30 days · #4,548
4.0k
★ total · +1% this week
437
forks · 27 open issues
Star history (as recorded here)
LanguagePython
License—
Created2026-02-25 (8mo ago)
Last pushtoday
OwnerUser
GitHub topics
anthropic-apiapple-siliconclaude-codecoding-agentscontinuous-batchinginference-serverllm-inferencellm-serverlm-studio-alternativelocal-ailocal-llmmacosmcpmlxmlx-lmollama-alternativeomlx-alternativeopenai-compatiblespeculative-decodingtool-calling
Links
- GitHub: github.com/raullenchai/Rapid-MLX
- Homepage: https://rapidmlx.com
- Releases · Issues · Hacker News mentions