arrow
返回

Texture-Enhanced Light Field Super-Resolution With Spatio-Angular Decomposition Kernels

delete2022-01-01
delete9
delete
OA
AI
Z
Zexi Hu
X
Xiaoming Chen *
H
Henry Wing Fung Yeung
Y
Yuk Ying Chung
陈志波 封面图
陈志波 (Zhibo Chen)
DOI:10.1109/TIM.2022.3152242delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Despite the recent progress in light field super-resolution (LFSR) achieved by convolutional neural networks, the correlation information of LF images has not been sufficiently studied and exploited due to the complexity of 4-D LF data. To cope with such high-dimensional LF data, most of the existing LFSR methods resorted to decomposing it into lower dimensions and subsequently performing optimization on the decomposed subspaces. However, these methods are inherently limited as they neglected the characteristics of the decomposition operations and only utilized a limited set of LF subspaces ending up failing to sufficiently extract spatio-angular features and leading to a performance bottleneck. To overcome these limitations, in this article, we comprehensively discover the potentials of LF decomposition and propose a novel concept of decomposition kernels. In particular, we systematically unify the decomposition operations of various subspaces into a series of such decomposition kernels, which are incorporated into our proposed decomposition kernel network (DKNet) for comprehensive spatio-angular feature extraction. The proposed DKNet is experimentally verified to achieve considerable improvements compared with state-of-the-art methods. To further improve DKNet in producing more visually pleasing LFSR results, based on the VGG network, we propose a light field VGG (LFVGG) loss to guide the texture-enhanced DKNet (TE-DKNet) to generate rich authentic textures and enhance LF images' visual quality significantly. We also propose an indirect evaluation metric by taking advantage of LF material recognition to objectively assess the perceptual enhancement brought by the LFVGG loss.
Keyword:
Feature extraction
Kernel
Cameras
Spatial resolution
Light fields
Visualization
Synthetic aperture sonar
Convolutional neural network (CNN)
deep learning
image processing
light field (LF) imaging
super-resolution

期刊

IEEE Transactions on Instrumentation and Measurement 封面图
IEEE Transactions on Instrumentation and Measurement
IF:
5.9
论文数:
2.0W
被引数:
5.8W

机构

U
University of Sydney
学者数:
6.5W
论文数: 6.2W
被引数: 90
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Judgment Capacity, Fear of Falling, and the Risk of Falls in Community-Dwelling Older Adults: The Progetto Veneto Anziani Longitudinal Study社区居住的老年人的判断能力,对跌倒的恐惧和跌倒的风险: Progetto Veneto Anziani纵向研究
err2020-06-01
err0
errOAAI
errCaterina Trevisan; Bruno M. Zanforlini; Stefania Maggi; Marianna Noale; Federica Limongi; Marina De Rui; Maria Chiara Corti; Egle Perissinotto; Anna-Karin Welmer; Enzo Manzato; Giuseppe Sergi
err分享
err收藏
Stereocontrolled Synthesis of Phenolic α-d-Glycopyranosides
err2016-06-14
err0
PREAI
errStephen Hanessian; Gabrielle St-Pierre; Laila Dafik; Ellen Klegraf
err分享
err收藏
CO2 laser irradiation enhances CaF2 formation and inhibits lesion progression on demineralized dental enamel—in vitro study
err2016-02-12
err0
PREAI
errBruna R. Zancopé; Lívia P. Rodrigues; Thais M. Parisotto; Carolina Steiner-Oliveira; Lidiany K. A. Rodrigues; Marinês Nobre-dos-Santos
err分享
err收藏
Immune responses to an attenuated West Nile virus NS4B-P38G mutant strain
err2011-06-01
err0
errOAAI
errThomas Welte; Guorui Xie; Jason A. Wicker; Melissa C. Whiteman; Li Li; Aparna Rachamallu; Alan Barrett; Tian Wang
err分享
err收藏
Efficient Light Field Reconstruction via Spatio-Angular Dense Network
err2021-01-01
err18
errOAAI
errHu, Zexi; Yeung, Henry Wing Fung; Chen, Xiaoming; Chung, Yuk Ying; Li, Haisheng
err分享
err收藏
LFNet: Light Field Fusion Network for Salient Object Detection
err2020-01-01
err92
PREAI
errZhang, Miao; Ji, Wei; Piao, Yongri; Li, Jingjing; Zhang, Yu; Xu, Shuang; Lu, Huchuan
err分享
err收藏
学者 查看更多内容