arrow
返回

AGNet: Attention Guided Sparse Depth Completion Using Convolutional Neural Networks

delete2022-01-01
delete4
delete
OA
AI
X
Xiaolong Liang
C
Cheolkon Jung *
DOI:10.1109/ACCESS.2022.3144596delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Sparse depth completion generates a dense depth image from its sparse measurement with the guidance of RGB image. In this paper, we propose attention guided sparse depth completion using convolutional neural networks, called AGNet. We adopt attention learning to get geometric cues for depth regression from RGB image and capture multi-scale depth structures. First, we use RGB image and valid binary mask from the input sparse depth image as input to generate an initial coarse depth image and its confidence map. Then, we generate attention map for depth refinement using a cross spatial attention module (CSAM). CSAM separately takes the RGB image with valid mask and invalid mask as input to make full use of color information in attention map. Next, we build a multi-scale learning network to encode the sparse depth image with different scales, thus leading to accurate depth completion. AGNet takes advantage of the input sparse depth image for encoding coarse features with a moderate model size. Experimental results show that AGNet achieves comparable performance with state-of-the-art methods for depth completion in NYU v2 dataset.
Keyword:
Feature extraction
Convolutional neural networks
Convolution
Spatial resolution
Image color analysis
Color
Task analysis
Depth completion
attention learning
convolutional neural networks
depth prediction
multi-scale learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
引用论文

引用论文

err分享
err收藏
Macrophage migration inhibitory factor (MIF): mechanisms of action and role in disease
err2002-04-01
err0
PREAI
errHongqi Lue; Robert Kleemann; Thierry Calandra; Thierry Roger; Jürgen Bernhagen
err分享
err收藏
Synthesis of Novel Ag Modified MCM-41 Mesoporous Molecular Sieve and Beta Zeolite Catalysts for Ozone Decomposition at Ambient Temperature
err2004-10-01
err0
PREAI
errNarendra Kumar; Petya M. Konova; Anton Naydenov; Teemu Heikill�; Tapio Salmi; Dmitry Yu. Murzin
err分享
err收藏
学者 查看更多内容