anthropics / claude-cookbooks

Jupyter notebooks and recipes demonstrating code patterns for building with the Claude API, including tool use, RAG, vision, and evaluations.

comet-ml / opik

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

dipakkr / awesome-ai-engineering

🚀 A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.

groundingpi / GroundingPI

A 4B grounding foundation model for physical intelligence. Unifies detection, referring, pointing, OCR, GUI, and layout grounding, achieving SOTA overall across 34 benchmarks and improving robot generalization and data efficiency in controlled evaluations.

UKGovernmentBEIS / inspect_ai

Inspect: A framework for large language model evaluations

yueliu1999 / Awesome-Jailbreak-on-LLMs

Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.

xmarre / ComfyUI-Spectrum-MiniMax-H3

Training-free Spectrum acceleration for ComfyUI’s native MiniMax H3 audio-video model. Uses Chebyshev ridge feature forecasting to skip selected H3 transformer evaluations, with adaptive scheduling, sampler-aware support for Euler, ER-SDE, RES, SEEDS and SA-Solver, CPU/VRAM history storage, and fail-closed native fallbacks.

AbdelStark / awesome-typesafe-jev

Awesome Jev: a source-backed field guide to TypeSafe's System One model, with SDKs, live demos, agent tools, and independent evaluations.

ktwu01 / benchmark-radar

Track 33,707+ AI benchmark, eval, dataset, and data-quality records from 40 public sources, with linked evidence and daily updates.

AI-Safety-Institute / transect

Transcript analysis for long-horizon agent evaluations

YuanKJing / Jev-as-Policy

The highly anticipated open-source repository for JEV as Policy enables one-click setup of the simulation environment. Evaluations of Astra + JEV on benchmarks such as RoboTwin will also be released soon.

Anil-matcha / awesome-gpt-6-astra

Evidence-backed use cases, prompts, integrations, evaluations, and safety notes for OpenAI GPT-6 Astra.

uoftcprg / pokerkit

An open-source Python library for poker game simulations, hand evaluations, and statistical analysis

Hona / openeval

Typed prompt-and-judge SDK, CLI, and evidence viewer for agent evaluations

nickname21kmr / gameops-investigator

Evidence-first game operations incident investigation agent with read-only MCP tools and reproducible evaluations.

Promethe-us / awesome-jev

A source-backed Jev / System One knowledge map: projects, papers, evaluations, robotics, and social discovery.

OmniJev / awesome-jev-gallery

🔥🔥 Awesome Jev: open-source models, projects, benchmarks, and independent evaluations for Jev and System One models.