B0yko / agent-claimcheck
git clone https://github.com/B0yko/agent-claimcheck.git
Catch AI agents that say "done" when the task isn't. Checks agent-trace/v1 traces with claim-evidence rules, LLM judges and a trained classifier, returns verified / false_success / unverifiable with calibrated confidence, and ships a 300-trace labelled benchmark.
+0
stars, 24h · #64,221
+~0
stars, 7 days · #61,837
+31
stars, 30 days · #21,127
31
★ total
0
forks · 0 open issues
Star history (as recorded here)
LanguagePython
LicenseApache-2.0
Created2026-09-28 (29d ago)
Last push2d ago
OwnerUser
GitHub topics
agent-evaluationagent-reliabilityai-agentsbenchmarkcalibrationevalsfalse-successhuman-in-the-loopllm-as-a-judgellm-evaluationopenai-compatiblepythontrace-analysis
Links
- GitHub: github.com/B0yko/agent-claimcheck
- Homepage: https://pypi.org/project/agent-claimcheck/
- Releases · Issues · Hacker News mentions
README
Loading README…