Entelligence-AI / agentplay

Replay your coding agent sessions as a map and a timeline

PostHog / posthog

:hedgehog: PostHog is the leading platform for building self-driving products. Our developer tools – AI observability, analytics, session replay, flags, experiments, error tracking, logs, and more – capture all the context agents need to diagnose problems, uncover opportunities, and ship fixes. Steer it all from Slack, web, desktop, or the MCP.

mlflow / mlflow

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

PrefectHQ / prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

comet-ml / opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

datahub-project / datahub

The Context Platform for your Data and AI Stack

Tracer-Cloud / opensre

Build your own AI SRE agents. The open source toolkit for the AI era.

dataelement / bisheng

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Arize-ai / phoenix

AI Observability & Evaluation

traceloop / openllmetry

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

tigerless-labs / cost-xray

See what Claude Code and Codex actually send to the API — and what each part costs.

ag2ai / faststream

Asynchronous Python framework for event-driven services. A thin client for Kafka, RabbitMQ, NATS, Redis and MQTT with full access to native broker features, plus AsyncAPI docs, in-memory tests and observability out of the box.

ai-boost / awesome-harness-engineering

Awesome list for AI agent harness engineering: tools, patterns, evals, memory, MCP, permissions, observability, and orchestration.

IBM / mcp-context-forge

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

pydantic / logfire

AI observability platform for production LLM and agent systems.

ascending-llc / jarvis-registry

Connect any AI copilot or autonomous agent to your enterprise tools — through a single, secure MCP/Agent gateway with built-in identity, access control, and full observability.

HolmesGPT / holmesgpt

SRE Agent - CNCF Sandbox Project

truera / trulens

Evaluation and Tracking for LLM Experiments and AI Agents

liaohch3 / claude-tap

Intercept and inspect Coding Agent API traffic from Claude Code, Codex CLI, Gemini CLI, Cursor CLI, OpenCode, Kimi/Kimi Code, Pi, and Hermes in a local trace viewer.

robusta-dev / robusta

Better Prometheus alerts for Kubernetes - smart grouping, AI enrichment, and automatic remediation

sodadata / soda-core

Data Contracts engine for the modern data stack. https://www.soda.io

future-agi / future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

uber / ADR

ADR secures enterprise AI agents through observability, security benchmarking, and threat detection. Deployed at Uber.

olalie / tapmap

Watch your computer connect across the internet in real time. Discover the world behind your apps.

Arize-ai / openinference

OpenTelemetry Instrumentation for AI Observability

Azure / agent-landing-zone

Enterprise-grade landing zone for AI agent applications on Azure. Deploy the secure infrastructure, the agent app, or both — built on Microsoft Foundry and Microsoft Agent Framework, with Zero-Trust networking, observability and IaC.

jwuthri-cloud / Tracely-ai

Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.

JudgmentLabs / judgeval

The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.

beizhu-1209 / AIHelms

企业级 AI 资源纳管平台，提供统一 AI网关、Token调度能力，纳管 OpenAI、Azure、Claude、DeepSeek 等主流模型，并支持 MCP 工具与 Skill 的集中注册分发。具备内外双轨定价、成本归因、统一身份认证、安全审计与效能报表，帮助企业精准控制成本、量化 ROI，高效治理 AI 资产。

MaxHu-xuan / task-state-guard

Reconcile stuck AI-agent tasks after restarts and timeouts. Preview SQLite changes, close stale delivery states, and never guess success.

cle-b / httpdbg

A tool for Python developers to easily debug the HTTP(S) client and server requests in a Python program.

chirpz-ai / pandaprobe

open source agent engineering platform: traces, evals, and metrics to debug and improve your AI agents. Integrates with LangGraph, CrewAI, Claude Agent SDK, and more.

mikehasa / agentacct

See what your coding agents did and what it cost. Breaks each task down into work steps — tools used, files changed, tests run, time and tokens spent. Local-first dashboard for Claude Code, Codex, OpenCode, and more. No login, no telemetry.

Abilityai / trinity

Self-hosted AI Agents Platform for AI Native companies. Claude Code, Codex, Gemini, OpenCode agents. Apache 2.0.

overmind-core / overmind

The platform for continuously improving AI agents.

DataDog / dd-trace-py

Datadog Python APM Client

elementary-data / dbt-data-reliability

This dbt package captures metadata, artifacts, and test results so you can detect anomalies, monitor data quality, and build metadata tables. It powers Elementary OSS and feeds the wider context layer used by Elementary Cloud’s full Data & AI Control Plane.

oxbshw / watch-skill

Give AI agents eyes, ears, and verifiable results. Watch Skill turns video, audio and screen activity into searchable, timestamped evidence and proves work with deterministic contracts, not model opinion. DeepWatch is the agent workspace built on DeepSeek Harness. Python + npm, MCP, CLI, REST, Web.

emma-sue / AegisOps

AegisOps企业信息系统智能运维平台：自动巡检、Agent 故障排查、证据工单与审批处置。LangGraph · Deep Agents · MCP；附可复现实测记录。

heaven999b / hello-agent-system

👋 Hello Agent System — learn enterprise AI agent system design by building every production layer from scratch. 17 bilingual lessons (EN/中文) with tested exercises: tools, architectures, reliability, security, evals, distributed execution, cost, RAG, release ops. 企业级 Agent 系统设计训练营

roy-tong / AgentMeasure

Inspect Codex / Claude logs, verify metering samples and re-count supported billing exports. Free local tools; bounded $10 diagnosis and $20 QA.

apimart001a / llm-gateway-comparison

LLM gateway comparison: self-hosted and managed AI API gateways compared on protocol compatibility, billing units, timeout and retry semantics, idempotency, quotas and observability.

Cygnux-Labs / Tracekit

Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.

limenagent / prodagent

A minimal, readable agent-framework kernel — understand how LangGraph/ADK work under the hood. 1800行代码的 agent 框架内核，理解 LangGraph/ADK 底层的工作原理

ConstantineChenn / SakikoMind

Enterprise AI customer-service Agent platform featuring hybrid intent recognition, multi-agent orchestration, MCP-powered RAG, dynamic Skills, memory, human handoff, observability and evaluation. 小祥智能客服系统，支持可追溯、可观测与云端部署。

morpheuslord / PICOTTY

PicoTTY is a simple serial tty serial console or somewhat of a IP KVM cause my homelab was just proxmox so serial is all I need.

aafqaq / codex-lb-enhanced

Production-ready Codex-compatible account-pool gateway with seamless failover, full-session recovery, native quota headers, WebSocket/HTTP bridge, and observability.

led829155-droid / RecSys-MLops

Production-style end-to-end e-commerce recommendation platform with data engineering, MLOps, serving, governance, and observability on Kubernetes.

using-system / otelyssey

OpenTelemetry plugins for every coding agent, in the Agent Plugins format — a marketplace that runs itself: open an issue, the repository validates, reviews, lists and follows your plugin.

shanananana / deepticket

An AI troubleshooting workbench for internal systems: it integrates ticketing and alerting systems via HTTP APIs and webhooks, connects code, logs, configurations, and agents, and provides a web-based self-service analysis interface for product, operations, and customer support teams.

adeelarshad414 / devops-interns-proj

A deliberately breakable three-tier platform plus a full DevOps / SRE / DevSecOps training curriculum (handbook, capstone assignment, solutions) for an intern rotation.

Nexilume-AI / nexus-cloud

Nexus — execution infrastructure for AI agents. Host agents in the cloud or behind NAT; let users attach and authorize their own computers and Android phones. Deploy once, work across devices. Python SDK · MCP · Shared run context · Browser, terminal and files · Built-in chat UI · Model routing.

EmbrasureAI / spark-observability-skills

Open-source agent skills for debugging and optimizing Apache Spark workloads

VinvAI / VinvAI

Tools for AI agents to test, fix and optimise your codebase

intikhab49 / open-jev-typed-decision-engine

Open reproduction of TypeSafe Jev: a 150M typed decision engine (noul/choice/score in one non-autoregressive pass, calibrated confidence). 0.697 vs Jev's 0.727, 2.5x better calibrated, 4x faster, free. Trains on a Colab T4 in 30 min.

ItIsMixian / Orrery

A portable skill for traceable Markdown project documentation, local observability, and safe migration.

datamllab / A2E

—

corneliafaulkner5 / gpt-6-sol-gateway-resources

Argolink-focused gateway selection and observability resources for GPT-6 Sol.

LobsterQBA / loop-agent

A Python app that shows how an agent calls tools, saves results, and recalls them after a restart.

aramintacolt2 / model-usage-observability

Argolink-focused usage events and model observability for GPT-6 Sol.