zhangshuibai / molten
git clone https://github.com/zhangshuibai/molten.git
Run a coding model at 300+ tok/s on your Mac. Native Rust + Metal inference engine for LiquidAI LFM2.5-24B-A2B (MLX 4-bit) on Apple Silicon.
—
stars, 24h
—
stars, 7 days
+25
stars, 30 days · #28,108
25
★ total
2
forks · 0 open issues
Star history starts 2026-11-08; the chart appears after the second daily snapshot.
LanguageMetal
LicenseApache-2.0
Created2026-10-25 (14d ago)
Last push10d ago
OwnerUser
GitHub topics
apple-silicongpu-kernelsinference-engineinference-optimizationlfm2liquid-aillama-cppllmllm-inferencellm-runtimelocal-llmmacosmetalmixture-of-expertsmlxquantizationrecursive-self-improvementrsirustself-improving-ai
Links
README
Loading README…