waybarrios / vllm-mlx
git clone https://github.com/waybarrios/vllm-mlx.git
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
1.6k
★ total
235
forks · 99 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguagePython
LicenseApache-2.0
Created2025-12-06 (10mo ago)
Last pushtoday
OwnerUser
GitHub topics
anthropicanthropic-apiapple-siliconclaude-codecontinuous-batchinginference-serverllmlocal-llmmacosmcpmlxmultimodal-aiopenaiopenai-apiopenai-compatiblespeech-to-texttext-to-speechtool-callingvision-language-modelvllm
Links
- GitHub: github.com/waybarrios/vllm-mlx
- Homepage: https://vllm-mlx.is-a.dev/
- Releases · Issues · Hacker News mentions