CSUNX233 / qwen3.8-27b-ninfer-5070tilaptop-kvmem-local-agent
git clone https://github.com/CSUNX233/qwen3.8-27b-ninfer-5070tilaptop-kvmem-local-agent.git
RTX 5070 Ti Laptop 12GB 跑 Qwen3.8-27B:NInfer + KVMem、256K 逻辑上下文、RAM KV、MTP、快速缓存续接与 dsh 本地 Agent / 搜索 / 浏览器。含源码、Windows 部署及实测。
+6
stars, 24h · #4,928
+~40
stars, 7 days · #5,102
+51
stars, 30 days · #13,222
51
★ total · +40% this week
2
forks · 1 open issues
Star history (as recorded here)
LanguageC++
LicenseApache-2.0
Created2026-10-15 (9d ago)
Last push3d ago
Watchers0
OwnerUser
GitHub topics
12gb-vramai-agentcudadeepseek-harnesskvmemlaptop-gpulocal-ailocal-llmlong-contextninferqwenqwen-27bqwen3-8rtx-5070-tispeculative-decodingwindows
Links
- GitHub: github.com/CSUNX233/qwen3.8-27b-ninfer-5070tilaptop-kvmem-local-agent
- Releases · Issues · Hacker News mentions
README
Loading README…