DingoOz / llm-visuals

git clone https://github.com/DingoOz/llm-visuals.git

Live truecolor terminal dashboard for a locally running LLM: tok/s, TTFT, GPUs, context, MTP acceptance, layer and real expert routing (llama.cpp)