Enderfga / SolarRenderer

SolarRenderer: Few-Step Generative Reference Rendering 
 🌐 Project Page •
 📄 Paper •
 🤗 Weights •
 🤗 Data •
 💻 Data code 
**SolarRenderer** turns a structure video from a game engine or an agent (grey box, semantic map, skeletons, depth,
body mesh, or a sketch it never saw in training) into a finished video, with an optional first frame and a prompt
deciding the look. It runs on **MiniMax-H3** with two LoRAs and renders a clip in **four steps**.
A block-causal pair of the same LoRAs streams the clip block by block.
SolarRenderer is built on SolarWM, the open framework for
training and inference of video world models (paper).
## News
- **[2026-10]** Code, weights, the shareable training data and the benchmark released.
## Highlights
- 🧱 **Any structure, one model**: no extra branch and no condition-type label; the prompt names the structure.
- ⚡ **Four steps**: structure-guided post-training, 12.3× faster sampling than 50 steps.
- 🎨 **Any look**: the same structure renders as photoreal, anime, pixel art or ink, set by the first frame and prompt.
- 🌊 **Streaming**: a block-causal version of both LoRAs renders the video block by block, each block shown as soon as
 it is done (guide).
- 📊 **Open benchmark**: 208 hard cases and 53 held-out clips, with scoring code, our renders and every judge verdict.
## Gallery
Structure video (left) and SolarRenderer (right).
| Scene grey box | Semantic segmentation |
|:---:|:---:|
| | |
| **Object masks + skeletons** | **SMPL body mesh** |
| | |
| **Near-field shaded geometry** | **Pencil storyboard** (unseen) |
| | |
| **Point cloud** (unseen) | **Child's crayon drawing** (unseen) |
| | |
| **Voxels** (unseen) | **Wireframe** (unseen) |
| | |
More structure types, styles and comparisons are on the project page.
## Quick Start
 [code] 
 [code] 
 [code] 
The example is a synthwave highway run (semantic map in, neon render out).
Add `--causal` with the two causal LoRAs to stream the clip block by block
(details).
- ✍️ **Prompts and first frames**: give `skills/solarrenderer-caption` to your coding
 agent (guide).
- 🎬 **Inference details**: inputs, sizes and timing (guide).
- 🏋️ **Training** on one 8-GPU node (guide).
- 📊 **Benchmark scoring** (guide).
## Citation
If you use SolarRenderer in your research, please cite SolarRenderer and SolarWM, the framework on which it is built.
 [code] 
SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models:
 [code] 
 Acknowledgement 
SolarRenderer builds on MiniMax-H3, starts its four-step LoRA from
DMAD, and shares its training framework with
SolarWM.
## License
Code: Apache 2.0. Weights: MiniMax H3 Community License,
including its territorial restrictions (EU, UK, Republic of Korea and US excluded) and Acceptable Use Policy; the
four-step LoRA is fine-tuned from DMAD under the same license.