📈 GH Trending Explorer 🎲 Surprise me

← all repos

NVIDIA / cosmos

git clone https://github.com/NVIDIA/cosmos.git Cosmos3 · 4mo ago

NVIDIA Cosmos is an open platform of world models, datasets, and tools that enables developers to build Physical AI for robots, autonomous vehicles, smart infrastructure, and more.

+7
stars, 24h · #2,066
+~49
stars, 7 days · #2,581
+~210
stars, 30 days · #2,523
12k
★ total · +0% this week
924
forks · 68 open issues

Star history (as recorded here)

2026-10-20 · 12,078 ★ 2026-10-22 · 12,097 ★
License—
Created2024-12-30 (1y ago)
Last pushtoday
Watchers96
OwnerOrganization

Links

README excerpt
# NVIDIA Cosmos
### World Foundation Models for Physical AI
**One model family that sees, reasons, simulates, and acts.**
**Try it in your browser** · **Quickstart** · **Find your path** · **Model Family** · **Cookbook**
 Physics-aware generation A Newton's cradle in motion: momentum transfer rendered with physical fidelity 
 Transfer World-scenario control layout → photoreal driving video 
 Action policy Policy run: "put the screwdriver and the glove in the purple container" 
 Simulation Generate synthetic data and create simulation for autonomous driving 
 Action-conditioned World Model Forward dynamics: egocentric rollout from input camera + hand pose 
 World reasoning Reason in complex real-world scenarios: a rolling ball means a child or pet may follow 
---
## What's new
- **[Oct 2026]**  Interactive World Simulation with Cosmos for Physical AI - example model checkpoints and training recipes: HF collection · Cookbook · Technical report (coming soon) · Website (coming soon).
- **[Jul 2026]** Cosmos3-Edge released - the 4B tier for on-device, real-time deployment (Jetson AGX Orin / Thor / RTX Pro 6000).
- **[May 2026]** Cosmos 3 released: HF collection · Technical Report.
## What is Cosmos?
NVIDIA Cosmos is an open platform for building physical AI applications, supporting industry verticals such as robotics, autonomous vehicles, smart infrastructure, manufacturing, healthcare, agriculture. The mission of Cosmos is to provide better data, better environment, better starting point, and better tooling for physical AI developers.
**Cosmos 3**, the current model family, is a suite of omnimodal world models built on a unified Mixture-of-Transformers architecture (technical report).
One model, two towers:
| | Inputs | Outputs | Use it for |
|---|---|---|---|
| **Reasoner** | text, vision | text | world understanding, grounding, task planning, embodied reasoning |
| **Generator** | text, vision, audio, action | vision, audio, action | world simulation, future prediction, synthetic data, policy learning |
This repository is the landing repo to start your physical AI journey with Cosmos. Here you can find detailed information on Cosmos models and explore Cosmos cookbook - a set of agent runnable recipes for various objectives and industries.
The recipes are supported by the Cosmos platform, including Cosmos Framework for training infra (SFT, LoRA, RL, distillation etc.), Cosmos Curator for data curation, and Cosmos Evaluator for model output evaluation.
## Find your path
 I want to… Go to Time 
 See it work - zero install Video generation , visual reasoning 1 min 
 Generate my first video Quickstart ↓ 10 min 
 Run generation/reasoning inference Inference recipes 10 min 
 Serve an OpenAI-compatible API Serving guide: vLLM, vLLM-Omni, or NIM 30 min 
 Post-train on my own data: SFT, LoRA, distill Post-train and distill recipes hours 
 Explore agent-runnable notebooks Cookbook browse 
 Evaluate a model Evaluation suites: PAIBench, Physics-IQ, VLMEvalKit h