📈 GH Trending Explorer 🎲 Surprise me

Search: pcie · Language: Python · AI hidden · clear

local-inference-lab / rtx6kpro

RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink

▲ ~14/7d ★ 1.2k Python 1d ago
nisesen / inferenceinquire

Real-time monitoring for llama.cpp inference servers: a read-only host agent plus a web dashboard for hardware, health and inference telemetry (prefill/decode vs context depth, slot occupancy, KV cache, GPU and PCIe).

▲ ~0/7d ★ 30 Python 26d ago
nguyenthimy2022kg-alt / Qwen-Flash-SM80-170HX

双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM:NVIDIA NVFP4、GDS、TEP2、MTP6,支持 1~10 并发,词表与 PCIe 通信优化。中英文部署与可构建源码。