All repos — GH Trending Explorer

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Helicone / helicone

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

lmnr-ai / lmnr

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

huggingface / aisheets

Build, enrich, and transform datasets using AI models with no code

darkrishabh / agent-skills-eval

A test runner for agentskills.io-style AI agent skills

ukanwat / overtime

Give a coding agent a brief, not a chat, and it works on its own across sessions. Includes an example run: an open-world city built in a real game engine with no human help. In early development.

dodoguardai / dodoguard

DodoGuard: Take AI Agents to Production. Test, validate, and operate AI Agents before and after deployment.for Dify, Coze, FastGPT, n8n, Tencent ADP, ByteDance HiAgent, and more.

Continuum-AI-Corp / OrcaReplay

OrcaReplay — Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team.

suncityldp / zx-bench

A reproducible local LLM benchmarking platform with versioned datasets, deterministic scoring, and auditable reports.

azbigboss66-oss / skillfoo-v3

Bounded, evidence-driven SKILL.md evolution under frozen evaluation and safety contracts.

lukstei / slop-grader

Jev-powered, rule-based grader for text files. Runs every rule against every line in parallel. No skimming, no missed lines.

jakemanger / whatmodel

Find the best AI models you can run

smkrv / jev-calibrate

Calibrate Jev questions against your own labels: tune criteria on labelled examples, confirm on a held-out set, get a verdict per question. Unofficial.