synchopate / llama-modchip
git clone https://github.com/synchopate/llama-modchip.git
🐋 Run 284B DeepSeek-V4-Flash (<59GiB RAM, 44.4 tok/s pp, 9.1-14.7 tok/s) & 30B MoEs (25-111 tok/s) on a pure 64GB CPU at 256K ctx (0 GPUs). SwiGLU-H2, Stockfish-PVS L3 & 13ms Claude Code restore.
+9
stars, 24h · #3,998
+36
stars, 7 days · #7,595
+82
stars, 30 days · #11,433
82
★ total · +36% this week
11
forks · 2 open issues
Star history (as recorded here)
LanguagePython
LicenseApache-2.0
Created2026-10-29 (9d ago)
Last push2d ago
Watchers0
OwnerUser
GitHub topics
ai-agentsapple-siliconavx512claude-codecpu-inferencedeepseekdeepseek-v4ggufhpcllama-cpplocal-llmmamba2mixture-of-expertsnemotronquantizationqwen3speculative-decodingstockfishzen5
Links
- GitHub: github.com/synchopate/llama-modchip
- Homepage: https://github.com/synchopate/llama-modchip#readme
- Releases · Issues · Hacker News mentions
README
Loading README…