1CatAI / 1Cat-vLLM
V100 / SM70-focused vLLM engineering fork for modern LLM inference.
1CatAI / 1Cat-vLLM
dnv2003 / v100-skinny
Hand-written NVFP4 W4A16 CUDA kernels for Volta
dollarwong / ninfer-v100
NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). Fork of Neroued/ninfer with sm70 vision-encoding speedup.
1115714829 / llama.cpp-v100
llama.cpp optimized for NVIDIA Tesla V100 (SM70): large MoE Qwen3.8-Flash-Next with MTP (prefill 3464 tok/s at 200K context, 6x V100-16GB) and Qwen3.8-27B with DFlash2 (decode up to 225 tok/s); 2-6 GPUs, 262K-512K context, multimodal, concurrent serving.
dg1kjd / sglang-sxm2
Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, MiniMax-H3.
rwashy / H3-V100
ComfyUI MiniMax H3 inference optimizations for NVIDIA Tesla V100 (SM70)