arrow
返回

Graph semantic information for self-supervised monocular depth estimation

delete2024-12-01
delete1
PRE
AI
D
Dongdong Zhang
C
Chunping Wang
H
Huiying Wang
Q
Qiang Fu *
DOI:10.1016/j.patcog.2024.110770delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Self-supervised monocular depth estimation has garnered significant attention in recent years due to its practical value in applications, as it eliminates the need for ground truth depth maps during training. However, its performance usually drops when estimating weakly textured regions and boundary regions, primarily due to the limited depth representation capability of traditional Convolutional Neural Networks (CNNs) that do not support topology. To address these issues, we propose a Graph Semantic Model (GSM) to improve self-supervised monocular depth estimation by utilizing graph learning and semantic information. Our focus is on improving feature representation through graph semantic information. Therefore, we incorporate semantic segmentation and depth estimation into one framework and enhance the interaction of different modal information through the Inter-Directed Graph Reasoning (IDGR) module. In addition, we design the Semantic-Guided Edge Graph Reasoning (SGEGR) module, aiming to boost the network's ability to perceive local depth. Extensive experiments on the KITTI dataset show that our method outperforms the state-of-the-art methods, particularly in accurately estimating depth within weakly textured regions and boundary regions.
Keyword:
Monocular depth estimation
Self-supervision
Convolutional neural networks
Graph learning

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

A
Army Engineering University of PLA
学者数:
5.0K
论文数: 3.7K
被引数: 5
引用论文

引用论文

Gas Hydrate System Offshore Chile
err2021-01-30
err0
errOAAI
errIvan Vargas-Cordero; Michela Giustiniani; Umberta Tinivella; Lucia Villar-Muñoz; Giulia Alessandrini
err分享
err收藏
Learning depth via leveraging semantics: Self-supervised monocular depth estimation with both implicit and explicit semantic guidance
err2023-05-01
err6
errOAAI
errLi, Rui; Xue, Danna; Su, Shaolin; He, Xiantuo; Mao, Qing; Zhu, Yu; Sun, Jinqiu; Zhang, Yanning
err分享
err收藏
MRI findings in people with epilepsy and nodding syndrome in an area endemic for onchocerciasis: An observational study
err2013-09-05
err0
errOAAI
errAS Winkler; K Friedrich; S Velicheti; J Dharsee; R König; L Jilek-Aall; A Nassri; M Meindl; A Kidunda; TH Müller; W Matuja; T Gotwald; E Schmutzhard
err分享
err收藏
HybridNet: Integrating GCN and CNN for skeleton-based action recognition
err2022-04-20
err30
PREAI
errYang, Wenjie; Zhang, Jianlin; Cai, Jingju; Xu, Zhiyong
err分享
err收藏
Resolution-sensitive self-supervised monocular absolute depth estimation分辨率敏感的自监督单目绝对深度估计
err2024-04-05
err5
PREAI
errZhou, Yuquan; Zhang, Chentao; Deng, Lianjun; Fu, Jianji; Li, Hongyi; Xu, Zhouyi; Zhang, Jianhuan
err分享
err收藏
Dynamic Graph CNN for Learning on Point Clouds用于点云学习的动态图CNN
err2019-10-10
err4.0K
errOAAI
errWang, Yue; Sun, Yongbin; Liu, Ziwei; Sarma, Sanjay E.; Bronstein, Michael M.; Solomon, Justin M.
err分享
err收藏
GCNDepth: Self-supervised monocular depth estimation based on graph convolutional networkGCNDepth: 基于图卷积网络的自监督单目深度估计
err2023-01-01
err31
errOAAI
errMasoumian, Armin; Rashwan, Hatem A.; Abdulwahab, Saddam; Cristiano, Julian; Asif, M. Salman; Puig, Domenec
err分享
err收藏
没有更多内容