A unified inference and post-training framework for accelerated video generation.
Make videos on the computer you already own. FreeVideo runs MiniMax H3 in as little as 8 GB of VRAM and 16 GB of RAM, and adapts its acceleration path to your hardware.
We propose Prism, a dynamic sparse attention framework for natively training joint video-audio generation models at 2K.
π₯ On-Policy Self-Distillation in Diffusion Models
HunyuanVideo: A Systematic Framework For Large Video Generation Model
π€ Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
Official Implementation of "DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Models"
High quality training free inpaint for every stable diffusion model. Supports ComfyUI
Multimodal RL training framework for diffusion & omni models
A unified framework for easy fine-tuning in Flow-Matching models
SparkDiffusion: Accelerating DiT video generation by 265Γ via joint Sparsity, Distillation, Quantization, etc.
LTX-Video Support for ComfyUI
A general fine-tuning kit geared toward image/video/audio diffusion models.
Lightweight Image Video Action Generation Inference Framework
[CVPR 2026] Towards Real-Time Diffusion-Based Streaming Video Super-Resolution β An efficient one-step diffusion framework for streaming VSR with locality-constrained sparse attention and a tiny conditional decoder.
Refine and improve the quality of small faces in MiniMax H3 video. Per-frame face tracking, crop, refine with H3, stitch back.
A 4B diffusion grounding model for fast, precise visual evidence extraction. Unifies diverse grounding tasks through parallel decoding, with optional self-speculative decoding delivering 4.51x autoregressive throughput on COCO.
Official Training and Benchmarking Implementation of PDMD: Projected Distribution Matching Distillation for Video Diffusion Models
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
Scalable and memory-optimized training of diffusion models
Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.
Official code of Motus: A Unified Latent Action World Model
A foundation model that generates synchronized video and audio in a single model
[ECCV 2026] Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagery
[ICML 2026] Official codebase for "Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation" & Causal Forcing++
Unified Codebase for Advanced World Models.
DeepInverse: a PyTorch library for solving imaging inverse problems using deep learning
Open data and scalable training for long-horizon video world models.
[ICCV 2025 & TPAMI] VistaDream: Sampling multiview consistent images for single-view scene reconstruction
Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform
SCoPE: Sightline-Coordinate Positional Encoding for 3D-Aware Video Generation
DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation
NVIDIA Sol-Attn for ComfyUI / Triton kernel on SM89 - SM121, with zero-copy MiniMax H3 nodes: memory-efficient attention, scheduled tau with graph preview, and feed-forward chunking. Measured 1.14β1.44Γ vs SageAttention and β37% MLP peak VRAM on H3
[ECCV 2026] Official implementation of "HRDiT: Training-Free High-Resolution Image Generation with Off-the-Shelf Diffusion Transformer Models"
Train LoRAs for Qwen-Image 2.1, FLUX.2 Klein 9B, FLUX.3 Image Klein, Krea 2, Z-Image, MOSS-Image, ERNIE-Image, Ideogram 4, Anima, SDXL (Pony, Illustrious, NoobAI), LTX 2.3, MiniMax-H3, and more on NVIDIA GPUs from 4β8 GB VRAM. One install, one launcher, NF4 models. Windows, Linux and RunPod.
Official Implementation for Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rollout
NovoWeave β a conceptual generative protein-design framework (non-functional pseudocode).
Apply 28-block Anima LoRAs to Anima-2.9B (40 blocks) with the correct block-index mapping, at load time and without converting files
Official implementation of "AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers"
Official code for InfoVis: one 9B model for slide image generation and editing, with the VisSlideBench benchmark and 15M+ training records.
π AUGUstus: Autonomous Driving VLA Model with Unified Generation and Understanding. ποΈ 512 H800 GPUs Β· ~2 days Β· 318K+ video hours Β· 513B+ training tokens. β‘ 12 Hz on-vehicle deployment. SFT + GRPO + NAVSIM.
Distributed image and video generation in ComfyUI for two NVIDIA DGX Sparks.
Exploring Learning and Optimization for Robot Motion Planning and Control.
MRI research guidance for coding agents β composable skills, established tools, and evidence-linked research memory. Install: npx skills add KeWang0622/MRFoundry
Official implementation of "GRACE: Generation-Aware Latent Compression for Efficient Video Generation" (arXiv 2610.10524)
High-performance OpenAI and Anthropic compatible omni-modality model inference server for Apple Silicon.
Implementation of papers in 100 lines of code.
The open .char format for consistent characters. Face, body, wardrobe & voice in one file, consistent across every model.