5258MF / ninfer-rtx3060-27b
git clone https://github.com/5258MF/ninfer-rtx3060-27b.git
RTX 3060 12GB/8GB 本地跑 27B 大模型：256K 上下文、约 45 token/秒，能看图、调工具，附懒人包和源码
+0
stars, 24h · #38,852
+~4
stars, 7 days · #22,498
+42
stars, 30 days · #15,439
42
★ total · +4% this week
3
forks · 0 open issues
Star history (as recorded here)
LanguageC++
License—
Created2026-09-30 (24d ago)
Last push11d ago
OwnerUser
Links
README
Loading README…