.png){kind=icon}
Return
Self-Supervised Monocular Depth Estimation Based on High-Order Spatial Interactions
.png){kind=icon}
PRE
AI
DOI：10.1109/JSEN.2023.3347585.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Depth estimation plays a pivotal role in various applications, including autonomous driving and robot navigation. In contrast to depth estimation using multiple images, such as stereo depth perception, inferring depth relations from a monocular camera is notably more challenging yet highly valuable. Traditionally, convolutional neural networks (CNNs) with residual structures have been extensively employed for this task, but they inherently constrain the model's feature extraction capabilities. Inspired by HorNet, in this article, we propose a novel self-supervised monocular depth estimation framework based on high-order spatial interactions, referred to as the Hor-Depth. Furthermore, the Hor-Depth improves feature fusion efficiency in the depth network decoder by incorporating the attentional feature fusion (AFF) module based on first-order spatial interaction, leading to more refined predicted disparity maps. To address issues of loss fluctuations and training instability, we introduce a progressive scale-weight adjustment strategy-based loss function. This strategy applies varying constraints to the model at different training stages, effectively reducing training fluctuations and mitigating outliers that significantly deviate from the predicted values. The proposed approach demonstrates exceptional performance in self-supervised monocular depth estimation, surpassing certain stereo supervised or monocular supervised methods, as evidenced by its impressive results on the KITTI Eigen split benchmark.
Keywords:
Estimation
Transformers
Training
Task analysis
Computational modeling
Sensors
Feature extraction
Depth estimation
high-order spatial interactions
monocular sensor estimation
self-supervised
Journal
IF:
4.5
Papers:
2.2W
Citations:
7.3W
Organization
No organization information available
Cited Papers
.png){kind=icon}
ShareSaveShareSaveShareSave
View more