📈 GH Trending Explorer 🎲 Surprise me

Search: pcie · Language: Python · clear

nisesen / inferenceinquire

Real-time monitoring for llama.cpp inference servers: a read-only host agent plus a web dashboard for hardware, health and inference telemetry (prefill/decode vs context depth, slot occupancy, KV cache, GPU and PCIe).

★ 30 Python 24d ago
nguyenthimy2022kg-alt / Qwen-Flash-SM80-170HX

双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM:NVIDIA NVFP4、GDS、TEP2、MTP6,支持 1~10 并发,词表与 PCIe 通信优化。中英文部署与可构建源码。