FlashInfer: Kernel Library for LLM Serving
GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spec decode
一个Turing专用vLLM分支,通过整合FlashInfer 0.6.18(PR #3526)与SM75后端门槛补丁(PR #47949),持续同步vLLM主线最新版本