Arize-ai / phoenix

AI Observability & Evaluation

openlit / openlit

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

lmnr-ai / lmnr

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

future-agi / future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

traceroot-ai / traceroot

TraceRoot - Open Source AI Agent Improvement Platform. YC S25

Abilityai / trinity

Self-hosted AI Agents Platform for AI Native companies. Claude Code, Codex, Gemini, OpenCode agents. Apache 2.0.

latitude-dev / latitude-llm

Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.

pydantic / logfire

AI observability platform for production LLM and agent systems.

truera / trulens

Evaluation and Tracking for LLM Experiments and AI Agents

beizhu-1209 / AIHelms

企业级 AI 资源纳管平台，提供统一 AI网关、Token调度能力，纳管 OpenAI、Azure、Claude、DeepSeek 等主流模型，并支持 MCP 工具与 Skill 的集中注册分发。具备内外双轨定价、成本归因、统一身份认证、安全审计与效能报表，帮助企业精准控制成本、量化 ROI，高效治理 AI 资产。