arrow
Return

Optical flow for video super-resolution: a survey

delete2022-07-19
delete6
PRE
AI
Z
Zhigang Tu *
L
Li, Hongyan
X
Xie, Wei
Y
Yuanzhong Liu
S
Shifu Zhang
B
Baoxin Li
J
Junsong Yuan
DOI:10.1007/s10462-022-10159-8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Video super-resolution is currently one of the most active research topics in computer vision as it plays an important role in many visual applications. Generally, video super-resolution contains a significant component, i.e., motion compensation, which is used to estimate the displacement between successive video frames for temporal alignment. Optical flow, which can supply dense and sub-pixel motion between consecutive frames, is among the most common ways for this task. To obtain a good understanding of the effect that optical flow acts in video super-resolution, in this work, we conduct a comprehensive review on this subject for the first time. This investigation covers the following major topics: the function of super-resolution (i.e., why we require super-resolution); the concept of video super-resolution (i.e., what is video super-resolution); the description of evaluation metrics (i.e., how (video) super-resolution performs); the introduction of optical flow based video super-resolution; the investigation of using optical flow to capture temporal dependency for video super-resolution. Prominently, we give an in-depth study of the deep learning based video super-resolution method, where some representative algorithms are analyzed and compared. Additionally, we highlight some promising research directions and open issues that should be further addressed.
Keywords:
Video super-resolution
Optical flow
Optical Flow-based video super-resolution
Temporal dependency

Journal

Artificial Intelligence Review cover
Artificial Intelligence Review
IF:
13.9
Papers:
6.1K
Citations:
1.9W

Organization

A
Arizona State University
Scholars:
2.7W
Papers: 2.5W
Citations: 4.2W
C
Central China Normal University
Scholars:
1.1W
Papers: 8.1K
Citations: 1.1W
H
hubei university of economics
Scholars:
615
Papers: 755
Citations: 0
A
arizona state university-tempe
Scholars:
1.5W
Papers: 1.2W
Citations: 13
W
wuhan university
Scholars:
8.0W
Papers: 5.8W
Citations: 70
researcher View more organizations