arrow
Return

Learning Depth for Scene Reconstruction Using an Encoder-Decoder Model

delete2020-01-01
delete8
delete
OA
AI
X
Xiaohan Tu
C
Cheng Xu *
S
Siping Liu
G
Guoqi Xie
J
Jing Huang
李仁发 cover
李仁发 (Renfa Li)
J
Junsong Yuan
DOI:10.1109/ACCESS.2020.2993494delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Depth estimation has received considerable attention and is often applied to visual simultaneous localization and mapping (SLAM) for scene reconstruction. At least to our knowledge, sufficiently reliable depth always fails to be provided for monocular depth estimation-based SLAM because new image features are rarely re-exploited effectively, local features are easily lost, and relative depth relationships among depth pixels are readily ignored in previous depth estimation methods. Based on inaccurate monocular depth estimation, SLAM still faces scale ambiguity problems. To accurately achieve scene reconstruction based on monocular depth estimation, this paper makes three contributions. (1) We design a depth estimation model (DEM), consisting of a precise encoder to re-exploit new features and a decoder to learn local features effectively. (2) We propose a loss function using the depth relationship of pixels to guide the training of DEM. (3) We design a modular SLAM system containing DEM, feature detection, descriptor computation, feature matching, pose prediction, keyframe extraction, loop closure detection, and pose-graph optimization for pixel-level scene reconstruction. Extensive experiments demonstrate that the DEM and DEM-based SLAM are effective. (1) Our DEM predicts more reliable depth than the state of the arts when inputs are RGB images, sparse depth, or the fusion of both on public datasets. (2) The DEM-based SLAM system achieves comparable accuracy as compared with well-known modular SLAM systems.
Keywords:
Simultaneous localization and mapping
Estimation
Image reconstruction
Decoding
Feature extraction
Cameras
Reliability
Convolutional neural networks
depth estimation
decoder
encoder
simultaneous localization and mapping
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
university at buffalo, suny
Scholars:
1.2W
Papers: 9.5K
Citations: 9
H
hunan university
Scholars:
4.5W
Papers: 3.3W
Citations: 70