dollarwong / ninfer-v100
git clone https://github.com/dollarwong/ninfer-v100.git
NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). Fork of Neroued/ninfer with sm70 vision-encoding speedup.
+0
stars, 24h · #34,683
+~2
stars, 7 days · #25,054
+~10
stars, 30 days · #29,284
50
★ total · +2% this week
9
forks · 1 open issues
Star history (as recorded here)
LanguageC++
LicenseApache-2.0
Created2026-09-15 (1mo ago)
Last push1mo ago
OwnerUser
Links
README
Loading README…