composo-ai / DishwasherBench

A dishwasher-loading game on a physical simulation of one real machine, built to benchmark language models and playable in a browser. The game inside is called Spotless.

review-bench / ReviewBench

ReviewBench is an open, reproducible benchmark for evaluating AI code review systems on real-world pull requests.

mintlify / index

Mintlify Index: retrieval engine and MCP server. Install: npx mint index

evaldock / EvalDock

An end-to-end evaluation framework for heterogeneous agents and plugins.

ryuxdsgn / design-intelligence

RYUX gives AI agents the design intelligence to understand product context, make intentional design decisions, and evaluate what they create.

DevMortimer / pi-typesafe

TypeSafe decisions for Pi: batched evaluation tool, terminal playground, and typed API for extension authors

microsoft / scope

Scope | Agentic Experience evaluation platform (Research preview)

woolcoxm / zero-mem-pi

Zero-Mem: Zero-Token Memory Operations for the pi coding agent (faithful reimplementation of arXiv:2607.29377)

aravelo7 / AgentPatchCheck

Coding Agent Runtime & Evaluation Harness for controlled repository-level software repair

samdotmak / jev-recall

Retrieve by relevance, not resemblance: filter an AI assistant's memories with TypeSafe's Jev

lukstei / slop-grader

Jev-powered, rule-based grader for text files. Runs every rule against every line in parallel. No skimming, no missed lines.

jakemanger / whatmodel

Find the best AI models you can run

AlchemyInCode / plumloom-autoeval-oss

Open-source CLI and MCP server for evaluating AI applications and gating releases with reliability evidence.

smkrv / jev-calibrate

Calibrate Jev questions against your own labels: tune criteria on labelled examples, confirm on a held-out set, get a verdict per question. Unofficial.

SagarBiswas-MultiHAT / promptVault

The private, offline-first prompt manager for AI Agent power users. Features AES-256 encrypted local storage, a built-in AI Librarian to evaluate & refine prompts with Gemini & Groq fallback, dynamic {{variable}} templates, Supabase cloud sync, analytics, and instant ⌘K search.

chetannada / Namaste-AI

Namaste AI — Free handwritten notes and study material covering AI concepts from the Namaste AI course. Explore the history of AI, neural networks, deep learning, transformers, LLMs, prompt engineering, RAG, AI agents, and more. An open-source learning resource by Chetan Nada.

vibeeval / receptionist

Private source backup of the Apache-2.0 phone receptionist core and Turkish local dashboard.

floydous / pi-agent-kernel

Pi coding agent extension for focused code retrieval, grounded edits, safety checks, and language-server support.

quqxui / dsh-memgas

Long-term memory plugin for DeepSeek Harness (dsh): four-channel retrieval fusion and continuous memory evolution. Memory construction and retrieval are based on MemGAS (ICLR 2026).