🤗 Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.
HunyuanVideo: A Systematic Framework For Large Video Generation Model
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
Production ready toolkit to run AI locally
A curated list of recent diffusion models for video generation, editing, and various other applications.
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
A unified inference and post-training framework for accelerated video generation.
《Pytorch实用教程》(第二版)无论是零基础入门,还是CV、NLP、LLM项目应用,或是进阶工程化部署落地,在这里都有。相信在本书的帮助下,读者将能够轻松掌握 PyTorch 的使用,成为一名优秀的深度学习工程师。
Materials for the Hugging Face Diffusion Models Course
LTX-Video Support for ComfyUI
A general fine-tuning kit geared toward image/video/audio diffusion models.
Lightweight Image Video Action Generation Inference Framework
Implementation of papers in 100 lines of code.
A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.
Make videos on the computer you already own. FreeVideo runs MiniMax H3 in as little as 8 GB of VRAM and 16 GB of RAM, and adapts its acceleration path to your hardware.
[CVPR 2026] Towards Real-Time Diffusion-Based Streaming Video Super-Resolution — An efficient one-step diffusion framework for streaming VSR with locality-constrained sparse attention and a tiny conditional decoder.
High quality training free inpaint for every stable diffusion model. Supports ComfyUI
[ICASSP 2024] 🍵 Matcha-TTS: A fast TTS architecture with conditional flow matching
Scalable and memory-optimized training of diffusion models
Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.
Multimodal RL training framework for diffusion & omni models
Wunjo Make: Face Swap, Lip Sync, Control Remove Objects & Text & Background, Restyling, Audio Separator, Clone Voice, Video Generation. Open Source, Local & Free.
A foundation model that generates synchronized video and audio in a single model
[ECCV 2026] Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagery
[ICML 2026] Official codebase for "Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation" & Causal Forcing++
Summary of key papers and blogs about diffusion models to learn about the topic. Detailed list of all published diffusion robotics papers.
Unified Codebase for Advanced World Models.
🔥 On-Policy Self-Distillation in Diffusion Models
DeepInverse: a PyTorch library for solving imaging inverse problems using deep learning
Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing Surveys, 2026.
Open data and scalable training for long-horizon video world models.
A collection of awesome video generation studies.
A collection of awesome text-to-image generation studies.
A unified framework for easy fine-tuning in Flow-Matching models
A Curated List of Awesome Video World Models with AR Diffusion: Covering Algorithms, Applications, and Infrastructure, Aimed at Serving as a Comprehensive Resource for Researchers, Practitioners, and Enthusiasts.
We propose Prism, a dynamic sparse attention framework for natively training joint video-audio generation models at 2K.
The open .char format for consistent characters. Face, body, wardrobe & voice in one file, consistent across every model.
[ICCV 2025 & TPAMI] VistaDream: Sampling multiview consistent images for single-view scene reconstruction
Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform
SparkDiffusion: Accelerating DiT video generation by 265× via joint Sparsity, Distillation, Quantization, etc.
Refine and improve the quality of small faces in MiniMax H3 video. Per-frame face tracking, crop, refine with H3, stitch back.
魔搭紫皮书|ModelScope Cookbook:面向开发者的开源模型应用实战指南,覆盖模型选型、推理、微调、评测、RAG、Agent 与 AIGC,从跑通第一个模型到构建实际应用。
DMAD: Distribution Matching as Adversarial Distillation for Fast Visual Generation
Generative models from scratch, progressively implemented in NumPy, C, and CUDA to uncover what ML frameworks hide.
NVIDIA Sol-Attn for ComfyUI / Triton kernel on SM89 - SM121, with zero-copy MiniMax H3 nodes: memory-efficient attention, scheduled tau with graph preview, and feed-forward chunking. Measured 1.14–1.44× vs SageAttention and −37% MLP peak VRAM on H3
Official Implementation of "DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Models"
Train LoRAs for Qwen-Image 2.1, FLUX.2 Klein 9B, FLUX.3 Image Klein, Krea 2, Z-Image, MOSS-Image, ERNIE-Image, Ideogram 4, Anima, SDXL (Pony, Illustrious, NoobAI), LTX 2.3, MiniMax-H3, and more on NVIDIA GPUs from 4–8 GB VRAM. One install, one launcher, NF4 models. Windows, Linux and RunPod.
Official Training and Benchmarking Implementation of PDMD: Projected Distribution Matching Distillation for Video Diffusion Models
Official Implementation for Mask Forcing: Improving Autoregressive Video Diffusion Distillation via Dual-Noise Masking Rollout
NovoWeave — a conceptual generative protein-design framework (non-functional pseudocode).
Official implementation of "Hierarchical Continuous Diffusion Language Models"
Efficient Stable Diffusion Fine-Tuning Framework 2026: Lightweight Config-Driven Pipeline
Zero-Config LoRA Fine-Tuning Studio for Diffusers 2026: The Ultimate Lightweight Trainer
Apply 28-block Anima LoRAs to Anima-2.9B (40 blocks) with the correct block-index mapping, at load time and without converting files
Official implementation of "AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers"
Official code for InfoVis: one 9B model for slide image generation and editing, with the VisSlideBench benchmark and 15M+ training records.
🚗 AUGUstus: Autonomous Driving VLA Model with Unified Generation and Understanding. 🏋️ 512 H800 GPUs · ~2 days · 318K+ video hours · 513B+ training tokens. ⚡ 12 Hz on-vehicle deployment. SFT + GRPO + NAVSIM.
Distributed image and video generation in ComfyUI for two NVIDIA DGX Sparks.
Exploring Learning and Optimization for Robot Motion Planning and Control.
MRI research guidance for coding agents — composable skills, established tools, and evidence-linked research memory. Install: npx skills add KeWang0622/MRFoundry