arrow
Return

Deformable 3D Convolution for Video Super-Resolution

delete2020-01-01
delete113
delete
OA
AI
X
Xinyi Ying
L
Longguang Wang
Y
Yingqian Wang
W
Weidong Sheng *
W
Wei An
Y
Yulan Guo
DOI:10.1109/LSP.2020.3013518delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The spatio-temporal information among video sequences is significant for video super-resolution (SR). However, the spatio-temporal information cannot be fully used by existing video SR methods since spatial feature extraction and temporal motion compensation are usually performed sequentially. In this paper, we propose a deformable 3D convolution network (D3Dnet) to incorporate spatio-temporal information from both spatial and temporal dimensions for video SR. Specifically, we introduce deformable 3D convolution (D3D) to integrate deformable convolution with 3D convolution, obtaining both superior spatio-temporal modeling capability and motion-aware modeling flexibility. Extensive experiments have demonstrated the effectiveness of D3D in exploiting spatio-temporal information. Comparative results show that our network achieves state-of-the-art SR performance. Code is available at: https://github.com/XinyiYing/D3Dnet.
Keywords:
Convolution
Three-dimensional displays
Motion compensation
Feature extraction
Image resolution
Signal resolution
Solid modeling
Video super-resolution
deformable convolution
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9