Framework for evaluating and improving agents
VLX-Seek is an efficient VLM that grounds fine-grained visual targets with high precision in wild environments.
Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
[Public alpha] Probability forecasting protocols, delayed-reward agent rollouts, and verifiable real-world task environments.
Install and Run Python Applications in Isolated Environments
An interface library for RL post training with environments.
NVIDIA Isaac Sim™ is an open-source application on NVIDIA Omniverse for developing, simulating, and testing AI-driven robots in realistic virtual environments.
[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
RL training environments for Microduck (mjlab)
PyBullet Gymnasium environments for single and multi-agent reinforcement learning of quadcopter control
A framework for building robust RL environments to train aligned AI.
A standard API for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)
Our library for RL environments + evals
Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.
A standard API for multi-agent reinforcement learning environments, with popular reference environments and related utilities
A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.
FinRL®-Meta: Dynamic datasets and market environments for FinRL.
Collections of robotics environments geared towards benchmarking multi-task and meta reinforcement learning
AgentSociety 2 is a modern, LLM-native agent simulation platform designed for social science research and experimental design. It provides a flexible framework for creating and managing intelligent agents in simulated environments.
Turn any repository into verifiable RL environments for coding agents - Harbor tasks you can train on, evaluate and share on the Hugging Face Hub
Isaac Lab - Arena is a robotics simulation framework that enhances NVIDIA Isaac Lab by providing a composable, scalable system for creating diverse simulation environments and evaluating robot learning policies. The framework enables developers to rapidly prototype and test robotic tasks with various robot embodiments, objects, and environments.
FineEnvs — RL Environments 101: building and scaling RL environments in the age of LLMs
SPADE: Self-Play in Adaptive Synthetic Executable Environments
NavSafe-∞: Benchmarking Closed-Loop Driving Safety in Photorealistic Environments
A collection of environments for autonomous driving and tactical decision-making tasks
A tool that allows you to create vulnerable instrumented local or cloud environments to simulate attacks against and collect the data into Splunk
Simple and easily configurable grid world environments for reinforcement learning
A collection of robotics simulation environments for reinforcement learning
A collection of scripts to set up MongoDB test environments and parse and visualize MongoDB log files.
Audits Python environments, requirements files and dependency trees for known security vulnerabilities, and can automatically fix them
MyoSuite is a collection of environments/tasks to be solved by musculoskeletal models simulated with the MuJoCo physics engine and wrapped in the OpenAI gym API.
Evaluate and improve models and agents using environments
Multi-objective Gymnasium environments for reinforcement learning
Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments
An integrated package configuration, build and deployment system for software
An engine for high performance multi-agent environments with very large numbers of agents, along with a set of reference environments
Untitled Goose Tool is a robust and flexible hunt and incident response tool that adds novel authentication and data gathering methods in order to run a full investigation against a customer’s Azure Active Directory (AzureAD), Azure, and M365 environments.
PettingZoo and Gymnasium bindings for popular reinforcement learning environments outside of Farama
open-source framework for creating and managing simulations populated with AI-powered agents. It provides an intuitive platform for designing complex, interactive environments where agents can act, learn, and evolve.
Gymnasium environments for NES Mario games, with task metadata, reward instrumentation, and reproducible evaluation interfaces.
🕹️ A diverse suite of scalable reinforcement learning environments in JAX
Cosmos-Transfer1 is a world-to-world transfer model designed to bridge the perceptual divide between simulated and real-world environments.
A set of communication oriented environments
A unified framework for robot learning
LiteReality-Agent: Turn the real world into simulation-ready environments.
Package conda environments for redistribution
Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.
Lightweight lockfile for conda environments
An RL-Gym for Challenge Problems in Data-Driven Modeling and Control of Fluid Dynamics.
A training-free multi-agent framework for recursive self-improvement in new environments through broad-then-deep autonomous exploration and reusable memory.
Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines
VietAIDetector: A robust, zero-shot AI-generated text detection system for Vietnamese. Built on the VietBinoculars algorithm with PhoGPT-4B and featuring Vintern-1B VLM for scanned PDF OCR. Optimized for dual-GPU environments with a Gradio Web UI.
Dexterous pen spinning and Rubik's cube: sim environments, zero-shot scripts, trained checkpoints
RecreationWorld: Scalable and Verifiable Environments for Hybrid Computer-Use Agents
ScienceIDE: Turning World’s Scientific Codebase into Agent Learnable Environments
A framework for building synthetic worlds for AI agents. Useful for RL and evaluation environments.
Generate Mujoco environments from natural language
[AAAI 2025] DeRainGS: Gaussian Splatting for Enhanced Scene Reconstruction in Rainy Environments
Multi-Industry Voice Agent Simulation Bench (MIVAS) is an indicator of voice AI performance across economic sectors. MIVAS is comprised of tasks and verifiers with granular rewards executed in production-grade multi-agent RL environments across industries where voice AI is being adopted the fastest.