Blackwellboy / model-serving-minefield
git clone https://github.com/Blackwellboy/model-serving-minefield.git
Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quant kernel paths, CUDA toolchains, KV allocation, eval harnesses, versioning. Symptom-first, with the check that catches each.
+0
stars, 24h · #24,384
+~0
stars, 7 days · #32,753
+~0
stars, 30 days · #36,381
140
★ total
17
forks · 19 open issues
Star history (as recorded here)
LanguagePython
LicenseMIT
Created2026-07-27 (2mo ago)
Last pushtoday
OwnerUser
GitHub topics
benchmarkingchat-templatecudadebuggingllama-cppllm-servinglm-evallocal-llmmodel-evaluationquantizationreasoning-modelsspeculative-decodingtroubleshootingvllm