Diffusion Probabilistic Modeling for Video Generation

doi:10.3390/e25101469

Diffusion Probabilistic Modeling for Video Generation

2023-10-20

0

OA

AI

DOI：10.3390/e25101469

原文链接

原文求助

摘要

En 中文

Denoising diffusion probabilistic models are a promising new class of generative models that mark a milestone in high-quality image generation. This paper showcases their ability to sequentially generate video, surpassing prior methods in perceptual and probabilistic forecasting metrics. We propose an autoregressive, end-to-end optimized video diffusion model inspired by recent advances in neural video compression. The model successively generates future frames by correcting a deterministic next-frame prediction using a stochastic residual generated by an inverse diffusion process. We compare this approach against six baselines on four datasets involving natural and simulation-based videos. We find significant improvements in terms of perceptual quality and probabilistic frame forecasting ability for all datasets.

Diffusion Probabilistic Modeling for Video Generation

摘要

期刊

机构

引用论文