arrow
返回

A Survey on Video Diffusion Models

delete2024-11-07
delete0
delete
OA
AI
Z
Zhen Xing
Q
Qijun Feng
H
Haoran Chen
Q
Qi Dai
H
Han Hu
H
Hang Xu
Z
Zuxuan Wu
Y
Yu–Gang Jiang *
DOI:10.1145/3696415delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The recent wave of AI-generated content (AIGC) has witnessed substantial success in computer vision, with the diffusion model playing a crucial role in this achievement. Due to their impressive generative capabilities, diffusion models are gradually superseding methods based on GANs and auto-regressive Transformers, demonstrating exceptional performance not only in image generation and editing, but also in the realm of video-related research. However, existing surveys mainly focus on diffusion models in the context of image generation, with few up-to-date reviews on their application in the video domain. To address this gap, this article presents a comprehensive review of video diffusion models in the AIGC era. Specifically, we begin with a concise introduction to the fundamentals and evolution of diffusion models. Subsequently, we present an overview of research on diffusion models in the video domain, categorizing the work into three key areas: video generation, video editing, and other video understanding tasks. We conduct a thorough review of the literature in these three key areas, including further categorization and practical contributions in the field. Finally, we discuss the challenges faced by research in this domain and outline potential future developmental trends. A comprehensive list of video diffusion models studied in this survey is available at https://github.com/ChenHsing/Awesome-Video-Diffusion-Models.
Keyword:
Survey
video diffusion model
video generation
video editing
AIGC

期刊

ACM Computing Surveys 封面图
ACM Computing Surveys
IF:
28
论文数:
2.5K
被引数:
3.5W

机构

F
fudan university
学者数:
11.8W
论文数: 7.7W
被引数: 121
M
Microsoft Research Asia
学者数:
421
论文数: 407
被引数: 2
M
Microsoft
学者数:
3.0K
论文数: 2.7K
被引数: 7
学者 查看更多机构
引用论文

引用论文

Association between comorbidities and dementia in diabetes mellitus patients: population-based retrospective cohort study
err2015-11-01
err0
PREAI
errShu-Chen Kuo; Shih-Wei Lai; Hung-Chang Hung; Chih-Hsin Muo; Shih-Chang Hung; Ling-Ling Liu; Chia-Wei Chang; Yueh-Juen Hwu; Shieh-Liang Chen; Fung-Chung Sung
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Movie Description电影描述
err2017-01-25
err166
errOAAI
errRohrbach, Anna; Torabi, Atousa; Rohrbach, Marcus; Tandon, Niket; Pal, Christopher; Larochelle, Hugo; Courville, Aaron; Schiele, Bernt
err分享
err收藏
Speech driven video editing via an audio-conditioned diffusion model通过音频条件扩散模型进行语音驱动的视频编辑
err2024-02-01
err4
errOAAI
errBigioi, Dan; Basak, Shubhajit; Stypulkowski, Michal; Zieba, Maciej; Jordan, Hugh; Mcdonnell, Rachel; Corcoran, Peter
err分享
err收藏
Persistent quasiplanar nematic texture: Its properties and topological defects
err2016-10-26
err0
PREAI
errPawel Pieranski; Maria Helena Godinho; Simon Čopar
err分享
err收藏
Generative Adversarial Networks生成对抗网络
err2020-10-22
err1.0W
errOAAI
errGoodfellow, Ian; Pouget-Abadie, Jean; Mirza, Mehdi; Xu, Bing; Warde-Farley, David; Ozair, Sherjil; Courville, Aaron; Bengio, Yoshua
err分享
err收藏
Continuously Sheared Granular Matter Reproduces in Detail Seismicity Laws
err2019-05-31
err0
errOAAI
errS. Lherminier; R. Planet; V. Levy dit Vehel; G. Simon; L. Vanel; K. J. Måløy; O. Ramos
err分享
err收藏
学者 查看更多内容