📈 GH Trending Explorer 🎲 Surprise me

Search: speculative-decoding · Language: Rust · clear

Dyluhn / R9V

Shape-specialized ROCm inference for Qwen3.8 Flash Next on RDNA4

★ 66 Rust 25d ago
gpillon / ignis

OpenAI-compatible inference server for Qwen3.8 on one RTX 5090 / RTX PRO 6000: the 27B at ~170 tok/s (peaks ~370), Flash-Next (125B MoE) at ~100 tok/s, built for local coding agents. Rust + CUDA, Windows and Linux.