langfuse / langfuse

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

traceroot-ai / traceroot

TraceRoot - Open Source AI Agent Improvement Platform. YC S25

FailproofAI / failproofai

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

VoltAgent / voltagent

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

lmnr-ai / lmnr

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

scasella / claude-flightdeck

A Claude Code mod that puts a live agent dashboard in your terminal: context and cost, advisor timeline, every permission check, subagent cards and swimlanes.

openlit / openlit

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

Helicone / helicone

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

latitude-dev / latitude-llm

Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.

loongsuite / dsh-plugin

OpenTelemetry tracing for DeepSeek Harness (dsh): turns each agent turn into a GenAI span tree — steps, LLM calls with TTFT, tool executions, token usage — exported over standard OTLP to Jaeger, Grafana Tempo, SigNoz, Langfuse, or any compatible backend.

mnfst / llm-gateway

Open Source LLM Gateway 🦚

duqaXxX / seedeep

What Claude Code is doing between your prompt and its answer, drawn live from the logs it already writes: every model call, every tool, each subagent on its own context window and its own model, and what the session produced. Local and read-only — your session content never leaves the machine.

comet-ml / opik-openclaw

🦞 Official plugin for OpenClaw that exports agent traces to Opik. See and monitor agent behaviour, cost, tokens, errors and more.

Continuum-AI-Corp / OrcaReplay

OrcaReplay — Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team.

Justin0504 / Aegis

Runtime policy enforcement for AI agents. Cryptographic audit trail, human-in-the-loop approvals, kill switch. Zero code changes.

ThinkWatchProject / ThinkWatch-Lite

Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.