πͺ’ Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework
OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.
A Claude Code mod that puts a live agent dashboard in your terminal: context and cost, advisor timeline, every permission check, subagent cards and swimlanes.
Laminar - open-source observability platform purpose-built for AI agents. YC S24.
Open Source LLM Gateway π¦
π§ Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 π
TraceRoot - Open Source AI Agent Improvement Platform. YC S25
Runtime policy enforcement for AI agents. Cryptographic audit trail, human-in-the-loop approvals, kill switch. Zero code changes.
Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.
Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.
Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.
π¦ Official plugin for OpenClaw that exports agent traces to Opik. See and monitor agent behaviour, cost, tokens, errors and more.
OrcaReplay β Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team.
What Claude Code is doing between your prompt and its answer, drawn live from the logs it already writes: every model call, every tool, each subagent on its own context window and its own model, and what the session produced. Local and read-only β your session content never leaves the machine.
OpenTelemetry tracing for DeepSeek Harness (dsh): turns each agent turn into a GenAI span tree β steps, LLM calls with TTFT, tool executions, token usage β exported over standard OTLP to Jaeger, Grafana Tempo, SigNoz, Langfuse, or any compatible backend.