lucia-huang7 / sglang-runtime-opt

git clone https://github.com/lucia-huang7/sglang-runtime-opt.git

Host-side scheduler and transfer-path optimization in SGLang on H100 with C++ descriptors, Triton and pinned memory