Leonccaa / ReVolta
git clone https://github.com/Leonccaa/ReVolta.git
Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/disk KV offload, and MTP or DFlash2 speculative decoding.
+0
stars, 24h · #67,686
+~28
stars, 7 days · #8,794
+37
stars, 30 days · #20,148
37
★ total · +28% this week
2
forks · 9 open issues
Star history (as recorded here)
LanguagePython
LicenseApache-2.0
Created2026-10-20 (16d ago)
Last pushtoday
OwnerUser
GitHub topics
awqflash-nextinference-serverkv-cache-offloadingllm-inferencenvfp4nvidia-v100qwenqwen3-8qwen3-8-flash-nextsm70speculative-decodingtesla-v100vllmvolta
Links
README
Loading README…