treeverse / dvc
🦉 Data Versioning and ML Experiments
treeverse / dvc
wandb / wandb
The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
snakemake / snakemake
This is the development home of the workflow management system Snakemake. For general information, see
the-nix-way / dev-templates
Dev environments for numerous languages based on Nix flakes [maintainer=@lucperkins]
Cloud-CV / EvalAI
:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
sipyourdrink-ltd / bernstein
The open-source governance layer for AI agents: write the rules declaratively, Bernstein enforces them and produces the verifiable, replayable record. Free, Apache-2.0. https://bernstein.run
ddsjoberg / gtsummary
Presentation-Ready Data Summary and Analytic Result Tables
ClawBio / ClawBio
🦖 ClawBio - The first bioinformatics-native AI agent skill library. Local-first. Reproducible. Open. Free.
cloud-gouv / securix
SécurixOS is a NixOS-based secure operating system tailored for small to medium-sized teams. It provides a minimal, hardened environment with strong isolation, reproducibility, and policy-driven configurations to ensure operational security and compliance.
nipreps / fmriprep
fMRIPrep is a robust and easy-to-use pipeline for preprocessing of diverse fMRI data. The transparent workflow dispenses of manual intervention, thereby ensuring the reproducibility of the results.
tweag / jupyenv
Declarative and reproducible Jupyter environments - powered by Nix
datavzrd / datavzrd
A tool to create visual HTML reports from collections of CSV/TSV tables
ServiceNow / AgentLab
AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
ailev / FPF
FPF (First Principles Framework) Library: a library of methods and pattern languages for engineering, research, management and human development, used by people and AI agents. Includes FPF Core, domain frameworks (DPFs) and Suites.
scaleapi / agentenv-framework
Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
XiantingWu / VeriRepro
VeriRepro: Evidence-grounded reproduction for computational papers.
Lucasuiii / modeling-workbench
Contest-native, evidence-focused math modeling workflow for Codex and Claude Code
fl-sean03 / OpenSDL
A modular Python foundation for reproducible computational and autonomous laboratories. Alpha; the reference profile is simulator-only.
ABCLDZ / open-world-research-reasoning-eval
Public reproducibility bundle for open-world deep-research reasoning evaluation
amos689 / paperdelta
Trace changed experiment results to the numbers, claims and figures in your LaTeX paper. Offline bilingual review, safe numeric patches and read-only MCP tools.
limingrui679-design / CascadeLens
Python-first systemic-risk research software for evidence-graded, bitemporal dependency graphs. Import JSON, CSV, GraphML, or NetworkX; run bounded shocks, compare constrained interventions and sensitivity surfaces, and export recomputation-verifiable RiskPacks. Includes 16 scenario-only cases and 11 connector contracts.
ZJU-REAL / ageval
Agent eval on one running base. Swap the agent under test with plugins; run the same dataset anywhere.
uczltw6 / trace-file-lineage
Find which script, notebook, data, command, or AI agent produced a file — locally, with evidence and honest uncertainty.
pengjk0-dotcom / TennisProfile
Reproducibility materials for reliability-aware tennis groundstroke profiling from monocular 3D human recovery
gxCaesar / open-research-skills
从选题到可复现发布：十个可独立安装的科研 agent skill —— 顶会/期刊论文、科研绘图、基金 proposal 撰写、方法迭代到 SOTA、冷审与代码数据发布。Ten installable agent skills for research: scientific figures, conference and journal manuscripts, research funding proposals, method development, cold review and artifact release.
pipelinelabai / paperbench-expanded
PaperBench High-Difficulty and Expanded Tasks: paper reproduction beyond machine learning. 93 tasks in 12 research areas, run in domain-native software and graded by clean replay. 12 public tasks.
Xiuyiw / CFD-SCIPaper-Agent
Author-in-the-loop toolkit for turning mature CFD evidence into defensible research directions, reproducible figures, and traceable scientific prose.
00200200 / repro-lens
Static reproducibility checks, experiment replay, and verification for ML pipelines.
jaz-lang / jaz-evals
Reproduction package for "Harness as a Language: A Minimalist Agent Framework With Maximal Expressivity" — ten agent arms across AppWorld and StuLife
Intelligible / elbi
Elbi gives your data agent a verified fact store.
zsxm1998 / awesome-perception-aware-rlvr
Unified reproductions, benchmarking & evaluation for perception-aware RLVR and OPD in VLMs. 19 methods · 30+ benchmarks · Official code of CGPO (ACM MM 2026 Oral).
MetaCircleAI / ComfyResearch
A platform for structuring AI research and studying physics of AI
HERRY423 / BioNexus
Scientific reliability layer for AI-assisted biology: evaluates what evidence warrants, caps unsupported claims, audits analytical validity, and prevents silent scientific overreach.
r0b0tlab / qwen38-27b-nvfp4-sm121-vllm
Qwen3.8-27B NVFP4 (W4A16 shipped recipe) + MTP on NVIDIA DGX Spark GB10/SM121 — vLLM v0.27.2rc0, FP8 KV, 262K context, full reproducibility pack
Nambekai / dangerous-person-detection-yolo11
YOLO11 research prototype for detecting people associated with potentially dangerous objects in public-area imagery, with thesis evidence, reproducibility notes, and responsible-use guidance.
tie-pilot-qxw / pdl-megakernel-reconstruction
Code and reproducibility artifacts for reconstructing megakernel persistence with CUDA PDL
cyptnpassira / PromptLedger
PromptLedger - version prompt templates, run deterministic comparison snapshots, score candidate responses, and ship diffable experiment reports. Python core plus a Go companion CLI.
AbdelStark / jev-benchmarks
Probability-aware evaluation for typed decision models: calibration, selective risk, latency, and reproducible benchmarks.
LAMDA-Model-Reuse / SaveRouter
Sparse-supervision LLM routing that accounts for upfront feedback acquisition and deployment payback.