arrow
返回

Self-Supervised Monocular Depth Estimation Based on High-Order Spatial Interactions

delete2024-02-15
delete1
PRE
AI
X
Xiuling Wang
M
Minglin Yu
H
Haixia Wang
X
Xiao Lu
Z
Zhiguo Zhang *
DOI:10.1109/JSEN.2023.3347585delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Depth estimation plays a pivotal role in various applications, including autonomous driving and robot navigation. In contrast to depth estimation using multiple images, such as stereo depth perception, inferring depth relations from a monocular camera is notably more challenging yet highly valuable. Traditionally, convolutional neural networks (CNNs) with residual structures have been extensively employed for this task, but they inherently constrain the model's feature extraction capabilities. Inspired by HorNet, in this article, we propose a novel self-supervised monocular depth estimation framework based on high-order spatial interactions, referred to as the Hor-Depth. Furthermore, the Hor-Depth improves feature fusion efficiency in the depth network decoder by incorporating the attentional feature fusion (AFF) module based on first-order spatial interaction, leading to more refined predicted disparity maps. To address issues of loss fluctuations and training instability, we introduce a progressive scale-weight adjustment strategy-based loss function. This strategy applies varying constraints to the model at different training stages, effectively reducing training fluctuations and mitigating outliers that significantly deviate from the predicted values. The proposed approach demonstrates exceptional performance in self-supervised monocular depth estimation, surpassing certain stereo supervised or monocular supervised methods, as evidenced by its impressive results on the KITTI Eigen split benchmark.
Keyword:
Estimation
Transformers
Training
Task analysis
Computational modeling
Sensors
Feature extraction
Depth estimation
high-order spatial interactions
monocular sensor estimation
self-supervised

期刊

IEEE Sensors Journal 封面图
IEEE Sensors Journal
IF:
4.5
论文数:
2.2W
被引数:
7.3W

机构

暂无机构信息
引用论文

引用论文

Gas Hydrate System Offshore Chile
err2021-01-30
err0
errOAAI
errIvan Vargas-Cordero; Michela Giustiniani; Umberta Tinivella; Lucia Villar-Muñoz; Giulia Alessandrini
err分享
err收藏
Learning to be a Depth Camera for Close-Range Human Capture and Interaction
err2014-07-27
err54
PREAI
errFanello, Sean Ryan; Keskin, Cem; Izadi, Shahram; Kohli, Pushmeet; Kim, David; Sweeney, David; Criminisi, Antonio; Shotton, Jamie; Kang, Sing Bing; Paek, Tim
err分享
err收藏
Variability Associated with Sampling, Sample Preparation, and Chemical Testing for Aflatoxin in Farmers' Stock Peanuts
err2020-01-14
err0
errOAAI
errThomas B Whitaker; Floyd E Dowell; Winston M Hagler; Francis G Giesbrecht; Jeremy Wu
err分享
err收藏
A Mono SLAM Method Based on Depth Estimation by DenseNet-CNN
err2022-02-01
err10
PREAI
errJin, Yifan; Yu, Lei; Chen, Zhong; Fei, Shumin
err分享
err收藏
MRI findings in people with epilepsy and nodding syndrome in an area endemic for onchocerciasis: An observational study
err2013-09-05
err0
errOAAI
errAS Winkler; K Friedrich; S Velicheti; J Dharsee; R König; L Jilek-Aall; A Nassri; M Meindl; A Kidunda; TH Müller; W Matuja; T Gotwald; E Schmutzhard
err分享
err收藏
Cyclosporin leukoencephalopathy induced by intravenous lipid solution
err1992-05-01
err0
PREAI
errN. De Klippel; J. Sennesael; J. Lamote; G. Ebinger; J. De Keyser
err分享
err收藏
err分享
err收藏
学者 查看更多内容