gpillon / ignis
git clone https://github.com/gpillon/ignis.git
OpenAI-compatible inference server for Qwen3.8 on one RTX 5090 / RTX PRO 6000: the 27B at ~170 tok/s (peaks ~370), Flash-Next (125B MoE) at ~100 tok/s, built for local coding agents. Rust + CUDA, Windows and Linux.
—
stars, 24h
—
stars, 7 days
—
stars, 30 days
28
★ total
6
forks · 50 open issues
Star history starts 2026-10-20; the chart appears after the second daily snapshot.
LanguageRust
LicenseApache-2.0
Created2026-09-01 (1mo ago)
Last push1d ago
OwnerUser
GitHub topics
blackwellcoding-agentscudainference-enginellmllm-inferencelocal-llmmixture-of-expertsnvfp4openai-apiopenai-compatibleqwenqwen3rtx-5090rustself-hostedspeculative-decoding
Links
- GitHub: github.com/gpillon/ignis
- Releases · Issues · Hacker News mentions