mohamedhossammohamed / m4-prefill-engine
git clone https://github.com/mohamedhossammohamed/m4-prefill-engine.git
Low-level Metal inference engine for Apple M4: universal quant formats at MLX parity, 1M-token out-of-core contexts, and speculative decode off flash storage.
+0
stars, 24h · #32,230
+~0
stars, 7 days · #41,797
+~0
stars, 30 days · #45,149
26
★ total
4
forks · 3 open issues
Star history (as recorded here)
LanguageObjective-C++
LicenseApache-2.0
Created2026-08-31 (1mo ago)
Last push1mo ago
OwnerUser
GitHub topics
Links
- GitHub: github.com/mohamedhossammohamed/m4-prefill-engine
- Homepage: https://mohamedhossammohamed.github.io/m4-prefill-engine/
- Releases · Issues · Hacker News mentions
README
Loading README…