truespar / paddock
git clone https://github.com/truespar/paddock.git
Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
136
★ total
21
forks · 8 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguageRust
License—
Created2026-09-03 (1mo ago)
Last push5d ago
OwnerOrganization
GitHub topics
aiaimodelsblackwellcudainferenceinference-engineinference-optimizationmacosmetalmlxmodel-servingnvidiarust