arrow
返回

Sparse depth densification for monocular depth estimation

delete2023-07-11
delete0
PRE
AI
Z
Zhen Liang
T
Tiyu Fang
Y
Yanzhu Hu *
Y
Yingjian Wang
DOI:10.1007/s11042-023-15757-4delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Now the dense depth prediction by single image and a few sparse depth measurements has attracted more and more attention because it provides a low-cost and efficient solution for estimating high-quality depth information. But the current existing methods for the field only take sparse depth as an independent dimension, and the relationship between sparse depth and image itself is always ignored, which undoubtedly limits the improvement of prediction accuracy. For solving the problem, in this paper, a sparse depth densification method is proposed to fully mine the relationship between sparse depth and image for achieving more accurate depth estimation. Based on a priori that the object areas of same category have similar depth values, a Depth Densification Map (DDM) is constructed by the segmentation label obtained from unsupervised image segmentation and sparse depth to realize sparse depth densification. Meantime, considering the potential error of DDM, a Depth Error Map (DEM) is designed to further correct DDM. Then, we use the idea of multi-scale fusion to build a depth estimation network. Finally, the proposed maps are combined with single image as the input of the network, and used to carry out the actual training and testing. Extensive experiments on NYU Depth v2 and Make3D datasets demonstrate the superiority of our proposed approach. Our code is available at . .
Keyword:
Monocular depth estimation
Unsupervised image segmentation
Sparse depth densification
Multi-scale fusion

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
1.9W
被引数:
3.2W

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
引用论文

引用论文

Unsupervised Scale-Consistent Depth Learning from Video
err2021-06-18
err111
errOAAI
errBian, Jia-Wang; Zhan, Huangying; Wang, Naiyan; Li, Zhichao; Zhang, Le; Shen, Chunhua; Cheng, Ming-Ming; Reid, Ian
err分享
err收藏
A New Kinect V2-Based Method for Visual Recognition and Grasping of a Yarn-Bobbin-Handling Robot
err2022-05-31
err9
errOAAI
errHan, Jinghai; Liu, Bo; Jia, Yongle; Jin, Shoufeng; Sulowicz, Maciej; Glowacz, Adam; Krolczyk, Grzegorz; Li, Zhixiong
err分享
err收藏
Self-Supervised Multiscale Adversarial Regression Network for Stereo Disparity Estimation
err2021-10-01
err29
PREAI
errWang, Chen; Bai, Xiao; Wang, Xiang; Liu, Xianglong; Zhou, Jun; Wu, Xinyu; Li, Hongdong; Tao, Dacheng
err分享
err收藏
Seismic profiles of the offshore Gulf of Alaska Tertiary Province, R/V Thompson, Sept.-Oct. 1974
err1975-01-01
err0
errOAAI
errRoland E. von Huene; B. F. Molnia; T. R. Bruns; P. R. Carlson
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容