[NeurIPS 2026] Safety failures in coding agents and frontier LLMs. Reproducible workspaces for studying when AI agents generate unsafe data during task completion.
Say It Simply, Test It Properly. Agent-powered strategy research with independent ledger checks and reproducible reports.
Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
FactCircuit: an auditable claim-and-evidence verification loop with immutable provenance, staged checks, bounded retrieval, and reproducible evaluation.
Reproducibility materials for reliability-aware tennis groundstroke profiling from monocular 3D human recovery
TEIN AI: the final glossy facial-performance mask workflow, with animated examples and reproducible setup.
A reactive notebook for Python β run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
Research and reproducible firmware tools for Sony A7C II (ILCE-7CM2).
AI data analyst for transparent, reproducible analysis. Works step by step in Python, verifies the evidence behind its reports, and supports a wide selection of models, including local open-weight models.
The open-source governance layer for AI agents: write the rules declaratively, Bernstein enforces them and produces the verifiable, replayable record. Free, Apache-2.0. https://bernstein.run
AI multi-agent tool that turns research papers into cited commercialization and tech-transfer assessments: TRL, patent landscape, market and risks. CrewAI + FastAPI, with a reproducible benchmark.
Agentic quant research workbench with CSV data inspection, local Codex and compatible APIs, predictive models, independent reviews, and reproducible backtests.
π‘ Build Python wheels for all the platforms with minimal configuration.
Local Laya typed decisions on Apple Core ML and Neural Engine. Validated ports, ~5 ms short decisions on M3 Max, reproducible speed and energy benchmarks.
Executable, measurable, and reproducible AI4AI toward recursive self-improvement. Home of OpenMLE and Frontis-MA1.
Trace changed experiment results to the numbers, claims and figures in your LaTeX paper. Offline bilingual review, safe numeric patches and read-only MCP tools.
The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
This is the development home of the workflow management system Snakemake. For general information, see
A platform for reproducible world model research and evaluation
Pyserini is a Python toolkit for reproducible information retrieval research with sparse and dense representations.
:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. π26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. π Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
π¦ ClawBio - The first bioinformatics-native AI agent skill library. Local-first. Reproducible. Open. Free.
Code to accompany our paper Chen and Zimmermann (2020), "Open source cross-sectional asset pricing"
A platform-neutral analytical Skill that profiles messy data, selects case-adaptive methods, and produces source-backed visual reports for high-stakes decisions.
Python toolkit, MCP server, and agent skills for reproducible, auditable clickstream and event log analytics. Helps AI agents, data scientists and analysts build, validate, and cross-check product analytics, quantitative UX, customer journeys, graph-based user flows, behavioral segmentation, A/B tests, process mining models, Markov chain simulation
Gymnasium environments for NES Mario games, with task metadata, reward instrumentation, and reproducible evaluation interfaces.
A research tool for the Iterated Prisoner's Dilemma
Observer Patch Holography: finite observer consensus, machine-checked mathematics and reproducible models for reconstructing physical structure.
RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.
AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
Command-first ATAC-seq footprinting, motif analysis, and reproducible interactive reports
Scientific hypothesis-discovery workbench: grounded hypothesis-evidence graphs, synthetic literature with planted causal chains, generate-debate-evolve loops over pluggable offline adapters, Elo tournaments recovering planted skill order, paraphrase dedup, Bayesian evidence accumulation, reproducible reports. NumPy core, CPU-only torch extra.
Ocarina of Time native on iOS and iPadOS via Ship of Harkinian with Metal rendering, touch controls, controller support, and ROM-free reproducible builds.
Evidence-first infrastructure for reproducible, isolated executable evaluation and online rewards.
Token θΆ ζ―οΌεΏ«η»ε²ε―ζ―ζη΅θ―οΌ Better Call Smith. Adaptive model routing, a glassy Codex usage monitor, and reproducible benchmarks with receipts.
Conditional integer multiplication: kappa > 2^-15. Community proofs, exact certificates and reproducible audits; assumes the OpenAI #109 framework.
Evolutionary multi-agent runtime that breeds, evaluates, and improves autonomous agents across reproducible epochs to converge on optimization of a goal.
LLM aberto e reprodutΓvel para o PortuguΓͺs do Brasil An Open, Reproducible Brazilian-Portuguese Language Model
CDAF (Cached Descriptive Asset Files) - open sidecar format for video so AI agents stop re-analyzing the same footage. Spec, CLI, agent skill, reproducible benchmark.
VeriRepro: Evidence-grounded reproduction for computational papers.
Contest-native, evidence-focused math modeling workflow for Codex and Claude Code
[EMNLP 2026] A multilingual benchmark for repository-level unit test generation, evaluating LLMs across 5 programming languages and real-world code under reproducible, Docker-based execution.
SimpleNav: A simple, unified, reproducible, and extensible framework for navigation VLA research.
Local VLA workbench: data diagnostics, reproducible preparation and reference training.
Solar PV yield and loss estimator with reproducible engineering calculations.
A modular Python foundation for reproducible computational and autonomous laboratories. Alpha; the reference profile is simulator-only.
Paper discovery and evidence-backed research team scouting two agent skills with a reproducible Python CLI.
Interactive Shanghai A-share research terminal with DeepSeek agents, evidence-linked news analysis, and a reproducible DCF valuation engine. Built with Next.js, FastAPI, and Python.
Public reproducibility bundle for open-world deep-research reasoning evaluation
Agent-friendly Markdown-to-video automation pipeline with reproducible rendering and pluggable media providers.
Reproducible refusal-subspace editing and TP=2 deployment of DeepSeek V4 Flash 0731 on two DGX Sparks
Python-first systemic-risk research software for evidence-graded, bitemporal dependency graphs. Import JSON, CSV, GraphML, or NetworkX; run bounded shocks, compare constrained interventions and sensitivity surfaces, and export recomputation-verifiable RiskPacks. Includes 16 scenario-only cases and 11 connector contracts.
Reproducible monthly demand forecasting with Random Forest, chronological backtests, transparent baselines, and a guided local app.
Agent eval on one running base. Swap the agent under test with plugins; run the same dataset anywhere.
Open and Reproducible Benchmarking for Relational Learning
Reproducible Microduck RL experiments, policies, simulation assets, and hardware add-ons
Find which script, notebook, data, command, or AI agent produced a file β locally, with evidence and honest uncertainty.
Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.