📈 GH Trending Explorer Updated 2026-11-04 10:02 UTC 🎲 Surprise me

Search: kv-cache-offloading · AI hidden · clear

Leonccaa / ReVolta

Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/disk KV offload, and MTP or DFlash2 speculative decoding.