arrow
Return

Deformable 3D Convolution for Video Super-Resolution

delete2020-01-01
delete113
delete
OA
AI
X
Xinyi Ying
L
Longguang Wang
Y
Yingqian Wang
W
Weidong Sheng *
W
Wei An
Y
Yulan Guo
DOI:10.1109/LSP.2020.3013518delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The spatio-temporal information among video sequences is significant for video super-resolution (SR). However, the spatio-temporal information cannot be fully used by existing video SR methods since spatial feature extraction and temporal motion compensation are usually performed sequentially. In this paper, we propose a deformable 3D convolution network (D3Dnet) to incorporate spatio-temporal information from both spatial and temporal dimensions for video SR. Specifically, we introduce deformable 3D convolution (D3D) to integrate deformable convolution with 3D convolution, obtaining both superior spatio-temporal modeling capability and motion-aware modeling flexibility. Extensive experiments have demonstrated the effectiveness of D3D in exploiting spatio-temporal information. Comparative results show that our network achieves state-of-the-art SR performance. Code is available at: https://github.com/XinyiYing/D3Dnet.
Keywords:
Convolution
Three-dimensional displays
Motion compensation
Feature extraction
Image resolution
Signal resolution
Solid modeling
Video super-resolution
deformable convolution
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Signal Processing Magazine cover
IEEE Signal Processing Magazine
IF:
9.6
Papers:
1.1W
Citations:
1.7W

Organization

N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9
Cited Papers

Cited Papers

Learning Temporal Dynamics for Video Super-Resolution: A Deep Learning Approach
err2018-07-01
err78
PREAI
errLiu, Ding; Wang, Zhaowen; Fan, Yuchen; Liu, Xianming; Wang, Zhangyang; Chang, Shiyu; Wang, Xinchao; Huang, Thomas S.
errShare
errSave
N-Doped Graphene-Supported PtRu Direct Methanol Fuel Cell Electrocatalysts
err2013-10-27
err0
errOAAI
errSvitlana Pylypenko; Kevin Nathaniel Wood; Alexey Serov; Plamen Atanassov; Ryan O'Hayre
errShare
errSave
Biomimetic hydroxylation of aromatic compounds: Hydrogen peroxide and manganese-polyhalogenated porphyrins as a particularly good system.
err1990-01-01
err0
PREAI
errMarie-Noelle Carrier; Corinne Scheer; Pascal Gouvine; Jean-François Bartoli; Pierrette Battioni; Daniel Mansuy
errShare
errSave
researcher View more