arrow
返回

Hierarchical Features Driven Residual Learning for Depth Map Super-Resolution

delete2019-05-01
delete151
PRE
AI
C
Chunle Guo
C
Chongyi Li *
郭继昌 封面图
郭继昌 (Jichang Guo)
R
Runmin Cong
H
Huazhu Fu
P
Ping Han
DOI:10.1109/TIP.2018.2887029delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Rapid development of affordable and portable consumer depth cameras facilitates the use of depth information in many computer vision tasks such as intelligent vehicles and 3D reconstruction. However, depth map captured by low-cost depth sensors (e.g., Kinect) usually suffers from low spatial resolution, which limits its potential applications. In this paper, we propose a novel deep network for depth map super-resolution (SR), called DepthSR-Net. The proposed DepthSR-Net automatically infers a high-resolution (HR) depth map from its low-resolution (LR) version by hierarchical features driven residual learning. Specifically, DepthSR-Net is built on residual U-Net deep network architecture. Given LR depth map, we first obtain the desired HR by bicubic interpolation upsampling and then construct an input pyramid to achieve multiple level receptive fields. Next, we extract hierarchical features from the input pyramid, intensity image, and encoder-decoder structure of U-Net. Finally, we learn the residual between the interpolated depth map and the corresponding HR one using the rich hierarchical features. The final HR depth map is achieved by adding the learned residual to the interpolated depth map. We conduct an ablation study to demonstrate the effectiveness of each component in the proposed network. Extensive experiments demonstrate that the proposed method outperforms the state-of-the-art methods. In addition, the potential usage of the proposed network in other low-level vision problems is discussed.
Keyword:
Convolutional neural network (CNN)
depth map super-resolution (SR)
residual learning
image reconstruction
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

C
Civil Aviation University of China
学者数:
3.0K
论文数: 1.9K
被引数: 1.5K
T
tianjin university
学者数:
8.0W
论文数: 5.8W
被引数: 88
引用论文

引用论文

err分享
err收藏
Involvement of the central nervous system in non-hodgkin's lymphoma
err1975-07-01
err0
errOAAI
errIvan P. Law; Fred R. Dick; Johannes Blom; Patrick R. Bergevin
err分享
err收藏
Left ventricular noncompaction (LVNC) and low mitochondrial membrane potential are specific for Barth syndrome
err2013-01-30
err0
errOAAI
errAgnieszka Karkucinska‐Wieckowska; Joanna Trubicka; Bozena Werner; Katarzyna Kokoszynska; Magdalena Pajdowska; Maciej Pronicki; Elzbieta Czarnowska; Magdalena Lebiedzinska; Jolanta Sykut‐Cegielska; Lidia Ziolkowska; Weronika Jaron; Anna Dobrzanska; Elzbieta Ciara; Mariusz R. Wieckowski; Ewa Pronicka
err分享
err收藏
Electronic and Steric Effects Control Regioselectivity in Alkyne Migratory Insertion during Ni-Catalyzed Indenone Synthesis
err2023-02-21
err0
PREAI
errLydia P. Moore; Zachary J. Hagedorn; Megan E. Barnes; Mei Lin N. Dye; Logan M. Whitt; Dale J. Wilger
err分享
err收藏
err分享
err收藏
学者 查看更多内容