📈 GH Trending Explorer 🎲 Surprise me

Search: speculative-decoding · Language: Rust · AI hidden · clear

Dyluhn / R9V

Shape-specialized ROCm inference for Qwen3.8 Flash Next on RDNA4

▲ ~7/7d ★ 67 Rust 28d ago
gpillon / ignis

OpenAI-compatible inference server for Qwen3.8 on one RTX 5090 / RTX PRO 6000: the 27B at ~170 tok/s (peaks ~370), Flash-Next (125B MoE) at ~100 tok/s, built for local coding agents. Rust + CUDA, Windows and Linux.