Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
OpenTelemetry Python API and SDK
Ray tracing and hybrid rasterization of Gaussian particles
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing Β· Evals Β· Simulations Β· Datasets Β· Gateway Β· Guardrails. Self-hostable. Apache 2.0.
A reactive Python kernel for Jupyter notebooks.
OpenTelemetry Instrumentation for AI Observability
LightAgent: Lightweight Python framework for OpenAI-compatible agents with tools, memory, guardrails, tracing, lifecycle hooks, multi-agent collaboration, and workflows.
Trace-native CI/CD for AI agents: grade production traces, cluster failures, freeze them into replayable regression tests, and block PRs that regress. Self-hostable.
WebGL 3D plotting for Jupyter: meshes, isosurfaces, volumes, voxels and point clouds from NumPy arrays, with a path-traced cinematic renderer.
Comprehensive optical design, optimization, and analysis in Python, including GPU-accelerated and differentiable ray tracing via PyTorch.
Free & Open Source Formula 1 Racing API
Blender Integration for LuxCore
open source agent engineering platform: traces, evals, and metrics to debug and improve your AI agents. Integrates with LangGraph, CrewAI, Claude Agent SDK, and more.
Differentiable optical lens simulator for end-to-end computational imaging.
The All-in-One System Profiling and Fault Detection Tool for Linux & Android
Datadog Python APM Client
Radar Simulator built with Python and C++
π΅ A Streamlit image-to-vector tool powered by the Vecto engine β upload PNG/JPG and get clean, editable SVG with live side-by-side preview. εΊδΊ Vecto εΌζηεΎη转 SVG ε·₯ε ·:δΈδΌ δ½εΎθͺε¨η’ιε,εε²θ§εΎε―Ήζ―,ε―ΌεΊ SVG/PNGγ
Open-source, license-free MCP server for RTL waveform debug: reads FST waveforms (VCD/FSDB auto-convert) plus a SystemVerilog netlist, with 34 tools covering driver analysis, value/X tracing, pass-fail waveform diff, a browser wave viewer the agent drives, and pre-simulation static analysis.
Multi-chain crypto wallet risk scanner for AML/KYT screening. Scores addresses 0β100 using sanctions, risky contracts and fund tracing. Integrates 6 intelligence providers with failover, detects scams, hacks, mixers and phishing, supports 15+ chains, batch screening and TXT/JSON/CSV/HTML/PDF reports. Python, cross-platform.
Tamper-evident tracing, policy gates and cross-checks for AI agents: see what the agent did, and why.
OpenTelemetry plugins for every coding agent, in the Agent Plugins format β a marketplace that runs itself: open an issue, the repository validates, reviews, lists and follows your plugin.
Monkey patch, test, and trace Python by attaching bindings to call sites, without modifying the code being observed. Built on wrapt.
SGTP: A Sampling-based Game-Theoretic Planning framework for real-time multi-vehicle autonomous racing.
Tools for AI agents to test, fix and optimise your codebase
A lightweight Windows image tracing overlay with adjustable opacity, zoom, size, position, and click-through mode for drawing over reference images.
β
Curated list of open-source LLMOps tools: tracing, evals, AI gateways, guardrails and prompt management. Sorted by stars, refreshed weekly.