📈 GH Trending Explorer 🎲 Surprise me

Search: nvlink · clear

weicj / vLLM-2080Ti-Definitive

The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord :https://discord.gg/VFqVVySdMS )

▲ ~18/7d ★ 1.2k Python 23d ago
local-inference-lab / rtx6kpro

RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink

▲ ~10/7d ★ 1.2k Python 1d ago
dg1kjd / sglang-sxm2

Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, MiniMax-H3.

▲ ~2/7d ★ 33 Python 17d ago