arrow
Return

Graph semantic information for self-supervised monocular depth estimation

delete2024-12-01
delete1
PRE
AI
D
Dongdong Zhang
C
Chunping Wang
H
Huiying Wang
Q
Qiang Fu *
DOI:10.1016/j.patcog.2024.110770delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Self-supervised monocular depth estimation has garnered significant attention in recent years due to its practical value in applications, as it eliminates the need for ground truth depth maps during training. However, its performance usually drops when estimating weakly textured regions and boundary regions, primarily due to the limited depth representation capability of traditional Convolutional Neural Networks (CNNs) that do not support topology. To address these issues, we propose a Graph Semantic Model (GSM) to improve self-supervised monocular depth estimation by utilizing graph learning and semantic information. Our focus is on improving feature representation through graph semantic information. Therefore, we incorporate semantic segmentation and depth estimation into one framework and enhance the interaction of different modal information through the Inter-Directed Graph Reasoning (IDGR) module. In addition, we design the Semantic-Guided Edge Graph Reasoning (SGEGR) module, aiming to boost the network's ability to perceive local depth. Extensive experiments on the KITTI dataset show that our method outperforms the state-of-the-art methods, particularly in accurately estimating depth within weakly textured regions and boundary regions.
Keywords:
Monocular depth estimation
Self-supervision
Convolutional neural networks
Graph learning

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

A
Army Engineering University of PLA
Scholars:
5.0K
Papers: 3.7K
Citations: 5
Cited Papers

Cited Papers

Gas Hydrate System Offshore Chile
err2021-01-30
err0
errOAAI
errIvan Vargas-Cordero; Michela Giustiniani; Umberta Tinivella; Lucia Villar-Muñoz; Giulia Alessandrini
errShare
errSave
Learning depth via leveraging semantics: Self-supervised monocular depth estimation with both implicit and explicit semantic guidance
err2023-05-01
err6
errOAAI
errLi, Rui; Xue, Danna; Su, Shaolin; He, Xiantuo; Mao, Qing; Zhu, Yu; Sun, Jinqiu; Zhang, Yanning
errShare
errSave
MRI findings in people with epilepsy and nodding syndrome in an area endemic for onchocerciasis: An observational study
err2013-09-05
err0
errOAAI
errAS Winkler; K Friedrich; S Velicheti; J Dharsee; R König; L Jilek-Aall; A Nassri; M Meindl; A Kidunda; TH Müller; W Matuja; T Gotwald; E Schmutzhard
errShare
errSave
HybridNet: Integrating GCN and CNN for skeleton-based action recognition
err2022-04-20
err30
PREAI
errYang, Wenjie; Zhang, Jianlin; Cai, Jingju; Xu, Zhiyong
errShare
errSave
Resolution-sensitive self-supervised monocular absolute depth estimation
err2024-04-05
err5
PREAI
errZhou, Yuquan; Zhang, Chentao; Deng, Lianjun; Fu, Jianji; Li, Hongyi; Xu, Zhouyi; Zhang, Jianhuan
errShare
errSave
errShare
errSave
Dynamic Graph CNN for Learning on Point Clouds
err2019-10-10
err4.0K
errOAAI
errWang, Yue; Sun, Yongbin; Liu, Ziwei; Sarma, Sanjay E.; Bronstein, Michael M.; Solomon, Justin M.
errShare
errSave
GCNDepth: Self-supervised monocular depth estimation based on graph convolutional network
err2023-01-01
err31
errOAAI
errMasoumian, Armin; Rashwan, Hatem A.; Abdulwahab, Saddam; Cristiano, Julian; Asif, M. Salman; Puig, Domenec
errShare
errSave
no more