NVIDIA / cosmos
git clone https://github.com/NVIDIA/cosmos.git
Cosmos3 · 4mo ago
NVIDIA Cosmos is an open platform of world models, datasets, and tools that enables developers to build Physical AI for robots, autonomous vehicles, smart infrastructure, and more.
+7
stars, 24h · #2,066
+~49
stars, 7 days · #2,581
+~210
stars, 30 days · #2,523
12k
★ total · +0% this week
924
forks · 68 open issues
Star history (as recorded here)
License—
Created2024-12-30 (1y ago)
Last pushtoday
Watchers96
OwnerOrganization
Links
- GitHub: github.com/NVIDIA/cosmos
- Homepage: https://www.nvidia.com/en-us/ai/cosmos/
- Releases · Issues · Hacker News mentions
README excerpt
# NVIDIA Cosmos ### World Foundation Models for Physical AI **One model family that sees, reasons, simulates, and acts.** **Try it in your browser** · **Quickstart** · **Find your path** · **Model Family** · **Cookbook** Physics-aware generation A Newton's cradle in motion: momentum transfer rendered with physical fidelity Transfer World-scenario control layout → photoreal driving video Action policy Policy run: "put the screwdriver and the glove in the purple container" Simulation Generate synthetic data and create simulation for autonomous driving Action-conditioned World Model Forward dynamics: egocentric rollout from input camera + hand pose World reasoning Reason in complex real-world scenarios: a rolling ball means a child or pet may follow --- ## What's new - **[Oct 2026]** Interactive World Simulation with Cosmos for Physical AI - example model checkpoints and training recipes: HF collection · Cookbook · Technical report (coming soon) · Website (coming soon). - **[Jul 2026]** Cosmos3-Edge released - the 4B tier for on-device, real-time deployment (Jetson AGX Orin / Thor / RTX Pro 6000). - **[May 2026]** Cosmos 3 released: HF collection · Technical Report. ## What is Cosmos? NVIDIA Cosmos is an open platform for building physical AI applications, supporting industry verticals such as robotics, autonomous vehicles, smart infrastructure, manufacturing, healthcare, agriculture. The mission of Cosmos is to provide better data, better environment, better starting point, and better tooling for physical AI developers. **Cosmos 3**, the current model family, is a suite of omnimodal world models built on a unified Mixture-of-Transformers architecture (technical report). One model, two towers: | | Inputs | Outputs | Use it for | |---|---|---|---| | **Reasoner** | text, vision | text | world understanding, grounding, task planning, embodied reasoning | | **Generator** | text, vision, audio, action | vision, audio, action | world simulation, future prediction, synthetic data, policy learning | This repository is the landing repo to start your physical AI journey with Cosmos. Here you can find detailed information on Cosmos models and explore Cosmos cookbook - a set of agent runnable recipes for various objectives and industries. The recipes are supported by the Cosmos platform, including Cosmos Framework for training infra (SFT, LoRA, RL, distillation etc.), Cosmos Curator for data curation, and Cosmos Evaluator for model output evaluation. ## Find your path I want to… Go to Time See it work - zero install Video generation , visual reasoning 1 min Generate my first video Quickstart ↓ 10 min Run generation/reasoning inference Inference recipes 10 min Serve an OpenAI-compatible API Serving guide: vLLM, vLLM-Omni, or NIM 30 min Post-train on my own data: SFT, LoRA, distill Post-train and distill recipes hours Explore agent-runnable notebooks Cookbook browse Evaluate a model Evaluation suites: PAIBench, Physics-IQ, VLMEvalKit h