RightNow-AI / local-kimi
git clone https://github.com/RightNow-AI/local-kimi.git
Optimized local serving engine for Kimi-Linear-48B: INT4 quantizer, fused decode kernels for a measured 3.18x, and an OpenAI-compatible server. Ships with k3, a bridge that detects the client per request so Claude Code, Codex, Cline, Aider and opencode all work unchanged.
+0
stars, 24h · #17,486
+~0
stars, 7 days · #17,961
+~0
stars, 30 days · #24,314
41
★ total
6
forks · 0 open issues
Star history (as recorded here)
LanguagePython
LicenseApache-2.0
Created2026-07-29 (2mo ago)
Last push1mo ago
OwnerOrganization
GitHub topics
Links
- GitHub: github.com/RightNow-AI/local-kimi
- Homepage: https://runinfra.ai
- Releases · Issues · Hacker News mentions