arrow
返回

Efficient Light Field Angular Super-Resolution With Sub-Aperture Feature Learning and Macro-Pixel Upsampling

delete2023-01-01
delete17
PRE
AI
刘高生 封面图
刘高生 (Gaosheng Liu)
岳焕景 封面图
岳焕景 (Huanjing Yue)
吴
吴嘉敏 (Jiamin Wu)
杨敬钰 封面图
杨敬钰 (Jingyu Yang) *
DOI:10.1109/TMM.2022.3211402delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The acquisition of densely-sampled light field (LF) images is costly, which hampers the applications of LF imaging technology in 3D reconstruction, digital refocusing, virtual reality, etc. To mitigate the obstacle, various approaches have been proposed to reconstruct densely-sampled LF images from sparsely-sampled ones. However, most existing methods still suffer from the non-Lambertian effect and large disparity issue. In this paper, we embrace the challenges by introducing a new paradigm for LF angular super-resolution (SR), which first explores the multi-scale spatial-angular correlations on the sparse sub-aperture images (SAIs) and then performs angular SR on macro-pixel features. In this way, we propose an efficient LF angular SR network, termed as EASR, with simple 3D (2D) CNNs and reshaping operations. The proposed EASR can extract effective feature representations on SAIs and can handle large disparities well by performing angular SR on macro-pixel features. Extensive comparisons with state-of-the-art methods demonstrate that our method achieves superior performance visually and quantitatively. Furthermore, our method achieves efficient angular SR by providing an excellent tradeoff between reconstruction performance and inference time.
Keyword:
Image reconstruction
Feature extraction
Three-dimensional displays
Spatial resolution
Correlation
Cameras
Superresolution
Light field
angular super-resolution
view synthesis
deep learning

期刊

IEEE Transactions on Multimedia 封面图
IEEE Transactions on Multimedia
IF:
9.7
论文数:
4.7K
被引数:
2.4W

机构

T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

Microsatellite Instability and Loss of Heterozygosity at Chromosomal Location 18q: Prospective Evaluation of Biomarkers for Stages II and III Colon Cancer—A Study of CALGB 9581 and 89803
err2011-08-10
err0
errOAAI
errMonica M. Bertagnolli; Mark Redston; Carolyn C. Compton; Donna Niedzwiecki; Robert J. Mayer; Richard M. Goldberg; Thomas A. Colacchio; Leonard B. Saltz; Robert S. Warren
err分享
err收藏
Rasmussen's Chronic Encephalitis in Adults
err1993-03-01
err0
PREAI
errR. S. McLachlan; J. P. Girvin; W. T. Blume; H. Reichman
err分享
err收藏
Expression of a soluble triggering receptor expressed on myeloid cells-1 (sTREM-1) correlates with clinical disease activity in intestinal Behcetʼs disease
err2011-10-01
err0
errOAAI
errYoon Suk Jung; Seung Won Kim; Jin Young Yoon; Jin Ha Lee; Soung Min Jeon; Sung Pil Hong; Tae Il Kim; Won Ho Kim; Jae Hee Cheon
err分享
err收藏
Immune responses to an attenuated West Nile virus NS4B-P38G mutant strain
err2011-06-01
err0
errOAAI
errThomas Welte; Guorui Xie; Jason A. Wicker; Melissa C. Whiteman; Li Li; Aparna Rachamallu; Alan Barrett; Tian Wang
err分享
err收藏
Back to the future: ecocentrism, organization studies, and the Anthropocene
err2022-06-01
err0
PREAI
errMarina Dantas de Figueiredo; Fábio Freitas Schilling Marquesan
err分享
err收藏
Conflits et tensions autour des usages de l'espace dans les territoires ruraux et périurbains. Le cas de six zones géographiques françaises
err2006-08-01
err0
PREAI
errAndré Torre; Olivier Aznar; M. Bonin; Armelle Caron; Eduardo Chia; M. Galman; Christine Lefranc; Romain Melot; Marc Guérin; Philippe Jeanneaux; Jean-Christophe Paoli; M.I. Salazar; Pascal THINON; Thierry Kirat
err分享
err收藏
学者 查看更多内容