StartLuxLabs / StartLux-Prism
git clone https://github.com/StartLuxLabs/StartLux-Prism.git
Fast, exact inference for StartLux-Decision models on NVIDIA GPUs: the released GGUF files on int8 and 4-bit tensor cores, behind the /v1/systemone API, with up to 5.3× lower latency than vLLM in FP8 and bit-identical answers.
—
stars, 24h
—
stars, 7 days
+55
stars, 30 days · #11,964
55
★ total
0
forks · 0 open issues
Star history starts 2026-10-24; the chart appears after the second daily snapshot.
LanguagePython
License—
Created2026-10-13 (10d ago)
Last push2d ago
OwnerOrganization
GitHub topics
calibrationcudacuda-graphsdecision-makingggufh200inference-engineint8llm-inferencenvidiaquantizationstartlux
Links
- GitHub: github.com/StartLuxLabs/StartLux-Prism
- Homepage: https://huggingface.co/startlux-models
- Releases · Issues · Hacker News mentions
README
Loading README…