nisesen / inferenceinquire

git clone https://github.com/nisesen/inferenceinquire.git

Real-time monitoring for llama.cpp inference servers: a read-only host agent plus a web dashboard for hardware, health and inference telemetry (prefill/decode vs context depth, slot occupancy, KV cache, GPU and PCIe).