modal-labs / modal-examples

Examples of programs built using Modal

Francis-Rings / StableAvatar

[NeurIPS2026] We present StableAvatar, the first end-to-end video diffusion transformer, which synthesizes infinite-length high-quality audio-driven avatar videos without any post-processing, conditioned on a reference image and audio.

Acly / comfyui-inpaint-nodes

Nodes for better inpainting with ComfyUI: Fooocus inpaint model for SDXL, LaMa, MAT, and various other tools for pre-filling inpaint & outpaint areas.

VILA-Lab / Awesome-DLMs

The official GitHub repo for the survey paper "A Survey on Diffusion Language Models".

Woolverine94 / biniou

a self-hosted webui for 30+ generative ai

OpenMOSS / MOVA

A foundation model that generates synchronized video and audio in a single model

jayin92 / Skyfall-GS

[ECCV 2026] Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagery

nv-tlabs / ardy

Official implementation of ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation (SIGGRAPH 2026).

thu-ml / Causal-Forcing

[ICML 2026] Official codebase for "Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation" & Causal Forcing++

madebyollin / taesd

Tiny AutoEncoder for Stable Diffusion (and other image models)

AspirinCode / papers-for-molecular-design-using-DL

List of Molecular and Material design using Generative AI and Deep Learning

SciML / DiffEqFlux.jl

Pre-built implicit layer architectures with O(1) backprop, GPUs, and stiff+non-stiff DE solvers, demonstrating scientific machine learning (SciML) and physics-informed machine learning methods

mbreuss / diffusion-literature-for-robotics

Summary of key papers and blogs about diffusion models to learn about the topic. Detailed list of all published diffusion robotics papers.

OpenDCAI / OpenWorldLib

Unified Codebase for Advanced World Models.

dipy / dipy

DIPY is the paragon 3D/4D+ medical imaging library in Python. Contains generic methods for spatial normalization, signal processing, machine learning, statistical analysis and visualization of medical images. Additionally, it contains specialized methods for computational anatomy including diffusion, perfusion and structural imaging.

dromara / Omega-AI

Omega-AI is a Java-based deep learning framework that helps you quickly build neural networks for inference and training. Its engine supports automatic differentiation, multithreading, and GPU acceleration with CUDA and cuDNN.

deepinv / deepinv

DeepInverse: a PyTorch library for solving imaging inverse problems using deep learning

hollowstrawberry / kohya-colab

Accessible Google Colab notebooks for Stable Diffusion Lora training, based on the work of kohya-ss and Linaqruf

EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing Surveys, 2026.

Junchao-cs / SolarWM

Open data and scalable training for long-horizon video world models.

AlonzoLeeeooo / awesome-video-generation

A collection of awesome video generation studies.

fishaudio / fish-diffusion

An easy to understand TTS / SVS / SVC framework

AlonzoLeeeooo / awesome-text-to-image-studies

A collection of awesome text-to-image generation studies.

runpod-workers / worker-comfyui

ComfyUI as a serverless API on Runpod

razorback16 / openjev

Open, Jev-compatible System One decision server on DiffusionGemma

gracezhao1997 / Awesome-Video-World-Models-with-AR-Diffusion

A Curated List of Awesome Video World Models with AR Diffusion: Covering Algorithms, Applications, and Infrastructure, Aimed at Serving as a Comprehensive Resource for Researchers, Practitioners, and Enthusiasts.

Acly / comfyui-tooling-nodes

Nodes for using ComfyUI as a backend for external tools. Send and receive images directly without filesystem upload/download.

YanWenKun / ComfyUI-Windows-Portable

🎨ComfyUI standalone pack with 40+ custom nodes. | ComfyUI 大号整合包，预装大量自定义节点（不含SD模型）

timmyy123 / LLM-Hub

Local LLM, image&video&music generator, run codex with local models on your phone

wanshuiyin / ARIS-in-AI-Offer

Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML, reads anywhere — plus a CV→DBLP-fact-checked academic homepage generator and hand-authored long-form blogs 🌱

yyeboah / Awesome-Text-to-3D

A growing curation of Text-to-3D, Diffusion-to-3D works.

AUTOMATIC1111 / stable-diffusion-webui-extensions

Extension index for stable-diffusion-webui

thu-ml / SLA

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention

WHU-USI3DV / VistaDream

[ICCV 2025 & TPAMI] VistaDream: Sampling multiview consistent images for single-view scene reconstruction

Yzw202011 / OmniSpace

本地优先的全栈 AI 创作工作站：AI对话 · AI漫画 · 漫剧创作 · 写作台 · 知识学习五大模块；vLLM / llama.cpp / Transformers 多引擎本地推理，显存智能调度、舱壁隔离自愈、仅供学习使用，欢迎交流指正。（最新进度（除插件系统）受到协议限制，暂时无法提交到仓库）

Visionary-Laboratory / visionary

Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform

apocas / restai

RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...

google-research / pointdit

[ICML'26] PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation

mmastrac / djev-spark

DiffusionGemma NVFP4 structured decisions on a DGX Spark: container recipe

TencentARC / SCoPE

SCoPE: Sightline-Coordinate Positional Encoding for 3D-Aware Video Generation

Yzmblog / DMAD

DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation

MirroS-Lab / AgentGarten

AgentGarten: Code Worlds for Evolving Agents

Davipar / djev-dev

Structured decisions with DiffusionGemma and vLLM. Native image inputs, image choices, live camera sampling, and a compact one-step inference path.

veda-sparse / Veda-on-ComfyUI

Veda Sparse Attention for ComfyUI

Heroesjouney / AIMovieStudiov2

Model-agnostic AI filmmaking workstation. 3D storyboard, ComfyUI local + Fal/Replicate cloud, multi-reference continuity, timeline export. Alternative to Storyboarder, LTX Studio.

sIlENtbuffER / Generative-Models

Generative models from scratch, progressively implemented in NumPy, C, and CUDA to uncover what ML frameworks hide.

Saganaki22 / ComfyUI-sol-attn

NVIDIA Sol-Attn for ComfyUI / Triton kernel on SM89 - SM121, with zero-copy MiniMax H3 nodes: memory-efficient attention, scheduled tau with graph preview, and feed-forward chunking. Measured 1.14–1.44× vs SageAttention and −37% MLP peak VRAM on H3

ralksta / ComfyUI-Photoshoot

Build a person once, then shoot a whole series: framing, pose, placement, expression and aspect ratio vary while the person stays the same. ComfyUI nodes.

zylwithxy / HRDiT

[ECCV 2026] Official implementation of "HRDiT: Training-Free High-Resolution Image Generation with Off-the-Shelf Diffusion Transformer Models"

csslc / PixRestore

Official code repository for "PixRestore: Unified Image Restoration via Pixel Diffusion Transformer".

ZinYY / AdaFlash

[COLMW'26 Spotlight] AdaFlash: Adaptive Speculative Decoding via On-Policy Distilled Diffusion Drafters

diffusionstudio / open-projects

Worked examples for Diffusion Studio, a video editor built for your agent.

Miint-Sunny / nai5-prompting

教 AI 写 NovelAI Diffusion V5 提示词的 skill：11 个拆分技能（构思＋写法）为主，另有合并版、单文件版和 4 千字的极简版；Agent Skills 标准封装。

mmastrac / djev

Jev-style structured decisions on DiffusionGemma: the example server from vLLM PR 57250

ifm-ai / uno

Unlocking Lossless Speedups in LLMs via Discrete Diffusion

fudan-generative-vision / WAM-Diff2

Hierarchical AR-to-Diffusion Distillation for Efficient Autonomous Driving VLA

AcademiaSD / AcademiaSD_LoRAlab-TrainerStudio

Train LoRAs for Qwen-Image 2.1, FLUX.2 Klein 9B, FLUX.3 Image Klein, Krea 2, Z-Image, MOSS-Image, ERNIE-Image, Ideogram 4, Anima, SDXL (Pony, Illustrious, NoobAI), LTX 2.3, MiniMax-H3, and more on NVIDIA GPUs from 4–8 GB VRAM. One install, one launcher, NF4 models. Windows, Linux and RunPod.

POInfra-AI / POInfra

Policy Optimization for Generative Models: diffusion and flow policies, online fine-tuning, and inference-time guidance and planning.

Elysia-Beloved / easy-LWE-watermark-

基于 Tree-Ring 水印工程，实现潜空间 LWE 环形隐写与 NC 检测，支持 Stable Diffusion 2.1 实验、信号失真和几何攻击、频率/小波能量分析，支持gradio Web界面实验。

chenkangjie1123 / VGGT-Diff

Official implementation of the paper "VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis."