arrow
Return

Light field super-resolution using complementary-view feature attention

delete2023-12-01
delete10
delete
OA
AI
W
Wei Zhang
W
Wenyan Ke *
D
Da Yang *
H
Hao Sheng
Z
Zhang Xiong
DOI:10.1007/s41095-022-0297-1delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Light field (LF) cameras record multiple perspectives by a sparse sampling of real scenes, and these perspectives provide complementary information. This information is beneficial to LF super-resolution (LFSR). Compared with traditional single-image super-resolution, LF can exploit parallax structure and perspective correlation among different LF views. Furthermore, the performance of existing methods are limited as they fail to deeply explore the complementary information across LF views. In this paper, we propose a novel network, called the light field complementary-view feature attention network (LF-CFANet), to improve LFSR by dynamically learning the complementary information in LF views. Specifically, we design a residual complementary-view spatial and channel attention module (RCSCAM) to effectively interact with complementary information between complementary views. Moreover, RCSCAM captures the relationships between different channels, and it is able to generate informative features for reconstructing LF images while ignoring redundant information. Then, a maximum-difference information supplementary branch (MDISB) is used to supplement information from the maximum-difference angular positions based on the geometric structure of LF images. This branch also can guide the process of reconstruction. Experimental results on both synthetic and real-world datasets demonstrate the superiority of our method. The proposed LF-CFANet has a more advanced reconstruction performance that displays faithful details with higher SR accuracy than state-of-the-art methods.
Keywords:
light field (LF)
super-resolution (SR)
attention

Journal

Computational Visual Media cover
Computational Visual Media
IF:
18.3
Papers:
319
Citations:
2.6K

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
M
Macao Polytechnic University
Scholars:
1.6K
Papers: 1.5K
Citations: 805
Cited Papers

Cited Papers

Immune responses to an attenuated West Nile virus NS4B-P38G mutant strain
err2011-06-01
err0
errOAAI
errThomas Welte; Guorui Xie; Jason A. Wicker; Melissa C. Whiteman; Li Li; Aparna Rachamallu; Alan Barrett; Tian Wang
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Nurses’ Attitudes Towards People with Dementia: the semantic differential technique
err2006-05-01
err0
PREAI
errKarl-Gustaf Norbergh; Yvonne Helin; Annika Dahl; Ove Hellzén; Kenneth Asplund
errShare
errSave
Conflits et tensions autour des usages de l'espace dans les territoires ruraux et périurbains. Le cas de six zones géographiques françaises
err2006-08-01
err0
PREAI
errAndré Torre; Olivier Aznar; M. Bonin; Armelle Caron; Eduardo Chia; M. Galman; Christine Lefranc; Romain Melot; Marc Guérin; Philippe Jeanneaux; Jean-Christophe Paoli; M.I. Salazar; Pascal THINON; Thierry Kirat
errShare
errSave
errShare
errSave
Light Field Inpainting Propagation via Low Rank Matrix Completion
err2018-04-01
err100
errOAAI
errLe Pendu, Mikael; Jiang, Xiaoran; Guillemot, Christine
errShare
errSave
Coded exposure photography
err2006-01-01
err0
PREAI
errRamesh Raskar; Amit Agrawal; Jack Tumblin
errShare
errSave
errShare
errSave
researcher View more