VoiceStudio is the open-source, fully-local ElevenLabs alternative β voice cloning, voice design, video dubbing, dictation, transcription & audiobook creation in 646 languages.
Local AI BGM and sound effects for Claude Code and any MCP client. Stable Audio 3 on Apple Silicon (MLX) and Windows NVIDIA GPUs (PyTorch). No cloud, no API key.
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
The open-source AI voice studio. Clone, dictate, create.
Hundreds of models & providers. One command to find what runs on your hardware.
MLX: An array framework for Apple silicon
LLM inference server with continuous batching & SSD caching for Apple Silicon β managed from the macOS menu bar
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop β all through one unified, production-ready inference API.
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.
Run LLMs with MLX
Native MLX runtime for Laya typed decision models β 7β14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.
Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
A library of extension and helper modules for Python's data analysis and machine learning libraries.
Semantic search over videos using Gemini Embedding 2 or Qwen3-VL.
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4Γ faster than Apple's MLX (mlx-lm) on the same weights.
Bonsai Demo
Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal β reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.
Apple MLX native implementations of state-of-the-art generative image & video models
Swift API for MLX
Community maintained hardware plugin for vLLM on Apple Silicon
Magenta RealTime 2: An Open-Weights Live Music Model
Local AI app and inference engine for agents. Run open-weight LLMs locally β private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
The native UI for Apple Containers and (o)MLX sandboxes, written in swift as a replacement for docker desktop
GoMLX: An Accelerated Machine Learning Framework For Go
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
Local AI, native to your Mac. Chat, serve, monitor, and connect MLX models from one macOS app.
AI speech toolkit for Apple Silicon β ASR, TTS, speech-to-speech, VAD, and diarization powered by MLX and CoreML
LM Studio Apple MLX engine
AirPosture: AirPods as posture coach
Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
MLX Studio - Easiest way to run LLM's on your Mac. All in one engine.
An implementation of the Nvidia's Parakeet models for Apple Silicon using MLX.
Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.
Optimized Whisper models for streaming and on-device use
vMLX - Use MLX models easily - JANGQ (GGUF for MLX) - Not dependant on mlx_vlm
AssetFurnace: the most complete open-source image-to-3D pipeline (Oct 2026). Prompt or picture β textured, rigged, animated game character, locally on Apple Silicon or NVIDIA. Pixal3D, TRELLIS.2, Hunyuan3D, SF3D, auto-rig and 21 moves. For indie game devs and 3D artists. Free, Apache-2.0.
LLMs and VLMs with MLX Swift
Spark-x2.5 open model series. Pushing the Limits of Agentic Capabilities in On-Device Models
A modular Swift SDK for audio processing with MLX on Apple Silicon
β‘ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
A fully local and private Speech-To-Text app, offering multiple model backends, diarization & calendar mode - Available for Windows, macOS & Linux
Up to 4Γ faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding β Gemma-4, Qwen3.8, Muse-Glimmer, Nemotron, LFM2.5, Ornith-1.0, ternary Bonsai-27B.
Node Creative Coding / 3D / Image Processing tool inspired by Quartz Composer
High-performance MLX-based LLM inference engine for macOS with native Swift implementation
Run any agent on any model, models stored as OCI images
Local AI chat for iPhone, iPad and Mac. Connect Ollama, LM Studio or any OpenAI-compatible server, or run MLX models on-device. Includes tools and web search.
Run a 105 GB AI model on a Mac that can't hold it. Slotstream streams Qwen3.8-Flash-Next (125B mixture of experts) from your SSD and caches the busiest experts in memory, so it runs on Macs with 16 to 64 GB. One native Swift binary on MLX and Metal, no Python, offline. Works with Claude Code, Codex and Ollama or OpenAI clients.
MLX port of moonshotai/Kimi-K3 (2.78T multimodal MoE): streaming converter, REAP expert pruning, and per-language expert-overlap analysis
A small proof-of-concept language model (not an LLM) that aims to incorporate latent-space prediction, internal state using recurrent trace units, and byte-by-byte output, built with MLX.
Phonon: open speech recognition models (Phonon-2, Phonon-1) β CLI, CPU and CUDA images
A Codex Skill for converting Beamer PDFs into editable PowerPoint decks with native equations.
Private, local text-to-speech for Apple silicon Macs
Dyno Lab β an AI safety, alignment and interpretability research workbench for Apple Silicon. Explore activations, probes, SAEs and interventions with local inference, a Python SDK, APIs and MCP.
Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac Studio, oMLX) over plain 10GbE
Imagination Studio by keys+Wasserman powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slate workflow by Sam Wasserman), render Qwen-Image-2.1 / FLUX3-K pictures and MiniMax H3 / FastH3 video with sound on TensorFold.