arrow
Return

Light Field Image Super-Resolution Using Deformable Convolution

delete2021-01-01
delete96
delete
OA
AI
Y
Yingqian Wang
J
Jungang Yang
L
Longguang Wang
X
Xinyi Ying
W
Wu, TH
A
An, Wei
Y
Yulan Guo *
DOI:10.1109/TIP.2020.3042059delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Light field (LF) cameras can record scenes from multiple perspectives, and thus introduce beneficial angular information for image super-resolution (SR). However, it is challenging to incorporate angular information due to disparities among LF images. In this paper, we propose a deformable convolution network (i.e., LF-DFnet) to handle the disparity problem for LF image SR. Specifically, we design an angular deformable alignment module (ADAM) for feature-level alignment. Based on ADAM, we further propose a collect-and-distribute approach to perform bidirectional alignment between the center-view feature and each side-view feature. Using our approach, angular information can be well incorporated and encoded into features of each view, which benefits the SR reconstruction of all LF images. Moreover, we develop a baseline-adjustable LF dataset to evaluate SR performance under different disparity variations. Experiments on both public and our self-developed datasets have demonstrated the superiority of our method. Our LF-DFnet can generate high-resolution images with more faithful details and achieve state-of-the-art reconstruction accuracy. Besides, our LF-DFnet is more robust to disparity variations, which has not been well addressed in literature.
Keywords:
Light field
super-resolution
deformable convolution
dataset

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9
Cited Papers

Cited Papers

A positively selected mutation in the WNV 2K peptide confers resistance to superinfection exclusion in vivo
err2014-09-01
err0
errOAAI
errCorey L. Campbell; Darci R. Smith; Irma Sanchez-Vargas; Bo Zhang; Pei-Yong Shi; Gregory D. Ebel
errShare
errSave
errShare
errSave
Making a Completely Blind Image Quality Analyzer
err2013-03-01
err4.2K
PREAI
errMittal, Anish; Soundararajan, Rajiv; Bovik, Alan C.
errShare
errSave
Rasmussen's Chronic Encephalitis in Adults
err1993-03-01
err0
PREAI
errR. S. McLachlan; J. P. Girvin; W. T. Blume; H. Reichman
errShare
errSave
Logistics Research and the Logistics World of 2050
err2013-01-01
err0
PREAI
errMatthias Klumpp; Uwe Clausen; Michael ten Hompel
errShare
errSave
Stereocontrolled Synthesis of Phenolic α-d-Glycopyranosides
err2016-06-14
err0
PREAI
errStephen Hanessian; Gabrielle St-Pierre; Laila Dafik; Ellen Klegraf
errShare
errSave
researcher View more