SOTA Open Source TTS
VPoser: Variational Human Pose Prior
Convert soccer event stream data to SPADL and value player actions using VAEP or xT
Neural latent upscaler for Minimax H3 (24ch). Bypasses costly 5B-param VAE decode/encode. Upscale low-res latents directly, then refine. Accelerates high-res video gen, outperforms naive interp.
[arxiv'26] GAE: Learning a Geometry-Native Latent Space for 3D-Consistent World Generation
LynnReal-Omni brings text-to-video, image-to-video, human- and hand-pose guided generation, structural control, omni-reference generation, style transfer, video editing, degraded-video restoration and streaming long-video generation into a single framework, all at four-step fast generation.
Running ONNX/TRT version of the MiniMax-H3 VAE in ComfyUI, which increase speed by up to 1.7x
Iris-3B: pixel-space generation & general vision learner. A 3B diffusion transformer that generates every pixel directly (no VAE); the same prior, fine-tuned, does monocular depth estimation and 4x image restoration. Paper, weights, training code and demo.
A unified audio-video variational autoencoder with cross-modal alignment for joint reconstruction and generation
Official implementation for paper "Fourier is Frontier: Frequency-Aware Autoencoding for High-Fidelity Music Reconstruction". We treat is as a new decoder for Music Reconstruction.
A nightly newspaper that writes itself: an agent runs the desks, the figures come from code, and it refuses to publish an edition with marks in it.
Phoneme alignment based on a variational autoencoder (VAE) and self-supervised learning (SSL) acoustic features.
ComfyUI nodes for MiniMax H3: INT8 X2 VAE and asynchronous NVENC saving. 5-second 1088x1920 video with audio in about 60 s on an RTX 4070 12GB, about 30% faster than the FP16 X2 VAE.
MiniMax-H3 33B audio+video DiT accelerated 1.54x on a single NVIDIA DGX Spark (GB10, sm_121): NVIDIA Sol-Engine FirstBlockCache + batched VAE decode ported to single-GPU ComfyUI, Sol-Attn patched for compute 12.1, kijai Triton INT8/TMA kernels. Benchmarks, charts, one-shot installer, agent recipe.
LightVAE: Fast video VAE decoders for Wan2.1, Wan2.2, and MiniMax-H3, plus a compressed H3 reference encoder. Pretrained weights and ComfyUI workflows.
Evidence-based European visa-sponsorship job intelligence for non-EU tech candidates.
Novahaku — 统一安全研究代理:Web测试 · 提示工程 · 攻击框架 · 逆向工程 · 请求重构
Encode, decode and plot audio with 10 neural audio codecs and audio VAEs (DAC, EnCodec, SNAC, Stable Audio Open, Music2Latent, ACE-Step and more), all through one interface. Useful for looking inside each model's latent space and comparing them side by side.