speridlabs / iris-3b

# Iris-3B
**Pixel-space generation & general vision learner**
Generative priors are a promising foundation for downstream vision tasks. In
this project we explore pixel-space generative models as an alternative to
vision foundation models such as DINOv2.
Iris-3B is a 3B-parameter diffusion transformer that generates directly in
pixel space: no VAE, no latent space, every pixel is produced by the model, so
nothing is lost to a lossy, texture-biased latent. It is not only an image
generator: the same pixel-space prior, fine-tuned, estimates monocular depth and
restores and upscales images — one backbone, three tasks. This repository contains the
model, the training and fine-tuning code, and inference.
Iris-3B Turbo is a 4-step distilled version of Iris-3B: a
1024×1024 image in about 0.7 s on one H100.
https://github.com/user-attachments/assets/2345a853-c673-4ddb-83b9-7e05c83198ed
## Generations
Samples from the final checkpoint at native aspect ratios of about one megapixel
(CFG 3, 100 steps, one fixed seed, no prompt rewriting).
 Studio portrait of a Maasai elder wearing vibrant beaded jewelry, deep red cloth, dark backdrop, Rembrandt lighting, ultra detailed skin texture 
 Close-up portrait of a young woman with silver glitter freckles and iridescent makeup, soft pastel background, high fashion beauty photography 
 A glass sculpture of a heart filled with flowers, caustics and reflections, 3D render 
 Black and white portrait of a fisherman with a thick grey beard and deep wrinkles, piercing eyes, overcast light, fine grain film photograph 
 A Byzantine-style mosaic of a peacock made of tiny gold and turquoise tiles, shimmering texture 
 A bronze sculpture of a horse in motion, patina, dramatic museum spotlight 
 The ancient city of Petra with the Treasury carved into pink sandstone, morning light 
 A tree with lightbulbs instead of fruits glowing at dusk, surreal concept art 
 Thousands of sky lanterns rising into the night sky at Yi Peng festival in Chiang Mai 
 The aurora borealis swirling green and violet over a snowy Lofoten fishing village with red wooden cabins, reflections in a calm fjord, night photograph 
 Volcanic eruption at night in Iceland, rivers of glowing lava flowing across black fields, plumes of steam lit orange, long exposure 
More samples: project page.
## One prior, many tasks
Iris-3B is a general vision learner, not only a text-to-image model: the same
pixel-space backbone, fine-tuned with no architectural change, does dense
vision tasks where detail matters. Both fine-tunes ship with the release (see
Depth, image restoration and upscaling for usage).
**Monocular depth** — photo → relative depth, one forward pass:
 Photo 
 Iris-3B depth 
 Photo 
 Iris-3B depth 
**Image restoration and upscaling** — degraded input → restored image:
 Input 
 Iris-3B 
 Input 
 Iris-3B 
Interactive depth point clouds and before/after sliders: project page
· demo.
## Model
| | |
|---|---|
| Parameters | 3B (excluding the frozen text encoder) |