pydata / numexpr

Fast numerical array expression evaluator for Python, NumPy, Pandas, PyTables and more

langchain-ai / openevals

Readymade evaluators for your LLM apps

Mathics3 / mathics-core

An open-source Mathematica Kernel. This repository contains the Python modules for WL Built-in functions, variables, core primitives, e.g. Symbol, a parser to create Expressions, and an evaluator to execute them.

danthedeckie / simpleeval

Simple Safe Sandboxed Extensible Expression Evaluator for Python

NVIDIA / SkillEvaluator

Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

dbt-labs / dbt-project-evaluator

This package contains native dbt checks to report and fix issues in your dbt project

uoftcprg / pokerkit

An open-source Python library for poker game simulations, hand evaluations, and statistical analysis

jsdhwfmax / EvalForge

Evaluator-neutral AI evaluation evidence, baseline regression gates, and JSON, JUnit, and SARIF reports for CI.

danielgshea / jev-as-a-judge

Using Jev as an evaluator.

Git-on-my-level / self-improving-agent-ecosystem

Reference architecture, contracts, skills, and fixtures for safe evaluator-driven self-improving ecosystems.

HongyeYangGT / Part_HackBench

A stress-testing benchmark for partial-completion evaluators in stateful multi-turn agents, focusing on temporary progress, rollback, and attribution failures.

Archive228 / adversarial-contract-gate

Self-evaluation is a trap — grade against a contract with a separate evaluator. Built from Anthropic's 'Build Agents That Run for Hours' (39:00). No deps, ./run.sh, 9 tests.