Luce-Org / lucebox
git clone https://github.com/Luce-Org/lucebox.git
LLM speculative inference server for heterogeneous hardware & consumer GPUs
+2
stars, 24h · #6,688
+~14
stars, 7 days · #7,363
+~60
stars, 30 days · #9,144
2.9k
★ total · +0% this week
285
forks · 109 open issues
Star history (as recorded here)
LanguageC++
LicenseApache-2.0
Created2026-04-03 (6mo ago)
Last pushtoday
OwnerOrganization
GitHub topics
cudacuda-kernelsdflashheterogeneous-computingkernelllama-cpplocal-ailucemegakernelpflashpoolsideqwenr9700rocmrtx3090sparkspeculative-decodingspeculative-prefillstrix-halo
Links
- GitHub: github.com/Luce-Org/lucebox
- Homepage: https://www.lucebox.com
- Releases · Issues · Hacker News mentions