A unified inference and post-training framework for accelerated video generation.
Make videos on the computer you already own. FreeVideo runs MiniMax H3 in as little as 8 GB of VRAM and 16 GB of RAM, and adapts its acceleration path to your hardware.
We propose Prism, a dynamic sparse attention framework for natively training joint video-audio generation models at 2K.
🔥 On-Policy Self-Distillation in Diffusion Models
HunyuanVideo: A Systematic Framework For Large Video Generation Model
🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
Official Implementation of "DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Models"
High quality training free inpaint for every stable diffusion model. Supports ComfyUI
Multimodal RL training framework for diffusion & omni models
A unified framework for easy fine-tuning in Flow-Matching models
SparkDiffusion: Accelerating DiT video generation by 265× via joint Sparsity, Distillation, Quantization, etc.
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
Production ready toolkit to run AI locally
LTX-Video Support for ComfyUI
A general fine-tuning kit geared toward image/video/audio diffusion models.
Lightweight Image Video Action Generation Inference Framework
[CVPR 2026] Towards Real-Time Diffusion-Based Streaming Video Super-Resolution — An efficient one-step diffusion framework for streaming VSR with locality-constrained sparse attention and a tiny conditional decoder.
Wunjo Make: Face Swap, Lip Sync, Control Remove Objects & Text & Background, Restyling, Audio Separator, Clone Voice, Video Generation. Open Source, Local & Free.
Refine and improve the quality of small faces in MiniMax H3 video. Per-frame face tracking, crop, refine with H3, stitch back.
魔搭紫皮书|ModelScope Cookbook:面向开发者的开源模型应用实战指南,覆盖模型选型、推理、微调、评测、RAG、Agent 与 AIGC,从跑通第一个模型到构建实际应用。
A 4B diffusion grounding model for fast, precise visual evidence extraction. Unifies diverse grounding tasks through parallel decoding, with optional self-speculative decoding delivering 4.51x autoregressive throughput on COCO.
Official Training and Benchmarking Implementation of PDMD: Projected Distribution Matching Distillation for Video Diffusion Models
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
Materials for the Hugging Face Diffusion Models Course
A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.
[ICASSP 2024] 🍵 Matcha-TTS: A fast TTS architecture with conditional flow matching
Scalable and memory-optimized training of diffusion models
Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.
Official code of Motus: A Unified Latent Action World Model
A foundation model that generates synchronized video and audio in a single model
[ECCV 2026] Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagery
[ICML 2026] Official codebase for "Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation" & Causal Forcing++
Summary of key papers and blogs about diffusion models to learn about the topic. Detailed list of all published diffusion robotics papers.
Unified Codebase for Advanced World Models.
DeepInverse: a PyTorch library for solving imaging inverse problems using deep learning
Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing Surveys, 2026.
Open data and scalable training for long-horizon video world models.
A collection of awesome video generation studies.
A collection of awesome text-to-image generation studies.
A Curated List of Awesome Video World Models with AR Diffusion: Covering Algorithms, Applications, and Infrastructure, Aimed at Serving as a Comprehensive Resource for Researchers, Practitioners, and Enthusiasts.
[ICCV 2025 & TPAMI] VistaDream: Sampling multiview consistent images for single-view scene reconstruction
Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform
SCoPE: Sightline-Coordinate Positional Encoding for 3D-Aware Video Generation
DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation
Generative models from scratch, progressively implemented in NumPy, C, and CUDA to uncover what ML frameworks hide.
NVIDIA Sol-Attn for ComfyUI / Triton kernel on SM89 - SM121, with zero-copy MiniMax H3 nodes: memory-efficient attention, scheduled tau with graph preview, and feed-forward chunking. Measured 1.14–1.44× vs SageAttention and −37% MLP peak VRAM on H3
[ECCV 2026] Official implementation of "HRDiT: Training-Free High-Resolution Image Generation with Off-the-Shelf Diffusion Transformer Models"
Train LoRAs for Qwen-Image 2.1, FLUX.2 Klein 9B, FLUX.3 Image Klein, Krea 2, Z-Image, MOSS-Image, ERNIE-Image, Ideogram 4, Anima, SDXL (Pony, Illustrious, NoobAI), LTX 2.3, MiniMax-H3, and more on NVIDIA GPUs from 4–8 GB VRAM. One install, one launcher, NF4 models. Windows, Linux and RunPod.
Official Implementation for Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rollout
NovoWeave — a conceptual generative protein-design framework (non-functional pseudocode).
Official implementation of "Hierarchical Continuous Diffusion Language Models"
Efficient Stable Diffusion Fine-Tuning Framework 2026: Lightweight Config-Driven Pipeline
Zero-Config LoRA Fine-Tuning Studio for Diffusers 2026: The Ultimate Lightweight Trainer
Apply 28-block Anima LoRAs to Anima-2.9B (40 blocks) with the correct block-index mapping, at load time and without converting files
Official implementation of "AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers"
Official code for InfoVis: one 9B model for slide image generation and editing, with the VisSlideBench benchmark and 15M+ training records.
🚗 AUGUstus: Autonomous Driving VLA Model with Unified Generation and Understanding. 🏋️ 512 H800 GPUs · ~2 days · 318K+ video hours · 513B+ training tokens. ⚡ 12 Hz on-vehicle deployment. SFT + GRPO + NAVSIM.
Distributed image and video generation in ComfyUI for two NVIDIA DGX Sparks.
Exploring Learning and Optimization for Robot Motion Planning and Control.
MRI research guidance for coding agents — composable skills, established tools, and evidence-linked research memory. Install: npx skills add KeWang0622/MRFoundry