truespar / paddock
Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio
truespar / paddock
onurburak9 / Qwen3.8-27B-Uncensored-MLX
—
maximpri / mlxtop
A top for local LLMs: memory, paging, GPU and tokens/s for oMLX, Ollama, llama.cpp, vLLM and more
virajbhartiya / laya-vs-jev
Laya vs Jev: local MLX and hosted AI decisions playing T-Rex side by side, with live metrics and replay recording
iamwavecut / MLX-DLSS
NVIDIA DLSS 5 neural rendering and DLSS frame generation on Apple Silicon (MLX/Metal, Core ML) and PyTorch; weights extracted from your own DLSS libraries
deskmind-ai / deskmind
Small enough to run on your Mac. Smart enough to ask. An open-source computer use agent for macOS, with local models (MLX) that see, decide and act. 得心，应手。
yibie / strata-mlx
Qwen3.8-Flash-Next on Apple Silicon: an MLX engine that reads Strata's GGUF files and speaks its line protocol (unofficial)
joshuaswarren / omarchy-mlx
MLX-compatible Vulkan and ANE backends for Apple Silicon running Linux.
atbender / deepseek-v41-flash-mac-mini
Run original DeepSeek V4.1 Flash FP4/FP8 weights on a 16 GB M1 Mac mini with bounded SSD streaming in MLX. Recipe, benchmarks, and demo.
Tylogi / MFQ
Get more intelligence from every bit. Better quantization formats and smarter calibration let larger, stronger models run smoothly on the hardware you already own.
PipeNetwork / minimax-h3-mlx
MLX (Apple Silicon) port of MiniMax-H3 — 33B joint video+audio diffusion. Validated against the diffusers reference; AdaLN precompute drops 13B at inference.
iannuttall / natter
Fast, local-first dictation for macOS
xzf-thu / BreezeTTS2_Mac_Streaming
Real-time Breeze-TTS-2 streaming on Apple Silicon — RTF from ~4 down to ~1. mlx-audio 0.5.1's depth decoder recomputes each frame's existing acoustic codes instead of reusing its KV cache. Adds intra-frame KV reuse, one CPU read-back per frame, an optional compiled whole-frame path, and RTF/underflow stats.
bnsd55 / jevmlx
Jev-style parallel constrained decisions for any MLX model on Apple Silicon. Typed, schema-valid JSON in one forward pass.
juliankang4 / spark-scope
Read-only dashboard and rack panel for NVIDIA DGX Spark-class nodes, other NVIDIA GPU Linux machines and Apple Silicon Macs running vLLM, SGLang, TensorFold, llama.cpp, Strata or oMLX
raullenchai / rapid-mlx-dsh-provider
Native Rapid-MLX provider for DeepSeek Harness (dsh) — dsh reads model facts from the server instead of your settings.yaml.
Weschera / Qwen3.8-27B-oMLX-MTP-Mac
Qwen 3.8 27B at 48-65 tok/s on a Mac Studio M4 Max — measured oMLX native-MTP recipe, same-day A/B vs mlx-vlm+MTP sidecar, raw benchmark JSON included
dio7153 / AquaType
適用於 Mac 的注音輸入法，按錯鍵也能列出正確的字詞。A Zhuyin input method for Mac that suggests the right words even when you press the wrong keys.
nanguoyu / minirun-app
Run Kimi K3 (2.8 T parameters,1.56 TB) on iPhone 16 Pro? Weights stream from your SSD through a memory budget you set. Free, local, on Mac and iPhone.
Layr-Labs / qwen-3.8-mtp-challenge
Qwen 3.8 27B MLX challenge — placeholder, not yet open.
davis7dotsh / inlay
Local-first dictation for macOS. Hold a key, speak, and type with on-device Whisper and MLX.
Misfits-Rebels-Outcasts / MLXUI
MLXUI is a Local AI Browser for MLX. Run MLX models AI Workflows.
drowzeys / keys-Mac-oMLX-0.6.3.2RC-Qwen3.8-27B-Dual-ANE-CPU-Abliterated-oQ4e
1.0 Beta · oMLX 0.6.3rc2 Dual-ANE+CPU · Qwen3.8-27B abliterated oQ4e · Mac Studio M3 Ultra
xdmlxdml / niulai-local-companion
Windows 本地牛来桌宠：头部追踪、坐下互动、拖动跑步、语音字幕与 Agent 联动
huyxdang / Tiny-GPT-Live
Can you train a GPT-Live with $50?
siamcafe / bomllm
Self-hosted AI platform on Apple Silicon — production-proven, Thai-optimized, $3.50/day
Greninja9257 / LabLLM
A native macOS lab for teaching tiny language models to think — build the architecture, train the weights, and watch a small LLM emerge from scratch, locally on Apple Silicon with custom data, tokenizers, checkpoints, and MLX acceleration.
caiovicentino / eikos
Open, calibrated, single-pass typed-decision models (4B & 27B) for finance and trading
manjunathshiva / opendecider
Open, calibrated System 1 decision models: typed choice / score / yes-no answers with a probability for every option. 400M to 80B; CPU, NVIDIA, Apple Silicon, LM Studio, Ollama and vLLM.
appautomaton / mlx-h3
Pure MLX MiniMax-H3 text-to-video-and-audio inference for Apple Silicon.
Badtheorylabs / Macaw
Macaw — on-device AI agent for macOS. 2.7B LFM2.5 fine-tune, MLX 4-bit, 97 macOS tools, no cloud.
Layr-Labs / mlxfast-bonsai2-27b-engine
Ternary Bonsai 2 27B MLX inference speedup benchmark engine
Generated-Computers / Locals
Run many AI agents at once on your Mac, about three times faster.
1amageek / swift-gigatoken
670 MB/s Swift tokenizer inspired by Marcel Roed’s gigatoken. Zero-copy, NEON/CRC32, WebAssembly, and Embedded Swift.
struffl / ishizuki
works well with rocks; native Apple Silicon inference engine for capable and tiny models (ternary, Qwen) via MLX Swift. Hadamard-rotated KV cache, vision, tool calling, OpenAI + Anthropic APIs
drowzeys / keys-Mac-TensorFold-MiniMax-H3-MLX
MiniMax H3 (video + audio) on TensorFold 0.6.5 with an H3 family, Mac Studio M5 Ultra: 5 s 864x480 clip in ~50 s, 40 s at 768x448 — the fastest H3 we have measured on Apple Silicon; int8 tensor-unit kernels + Turbo adapter; one-shot + GHCR carrier
WestWaters / pollard-weights
A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from flash. Ships the residency calculator, measurement harnesses, and the build recipes behind it. Predictions validated against public benchmarks.
nyosegawa / asist
A realtime assistant for Mac and Windows. Talk to it and it answers aloud, shows your schedule and mail as cards, and hands longer work to an agent.
ankit-aglawe / tinyjev
A tiny jev-like model that answers Choice, Score and Noul questions in one forward pass and returns calibrated probabilities. MLX or PyTorch, fully offline, System One compatible.
mohamedhossammohamed / m4-prefill-engine
Low-level Metal inference engine for Apple M4: universal quant formats at MLX parity, 1M-token out-of-core contexts, and speculative decode off flash storage.
InferMatrixLab / vllm-omni-mlx
High-performance OpenAI and Anthropic compatible omni-modality model inference server for Apple Silicon.