.png){kind=icon}
返回
STViT plus : improving self-supervised multi-camera depth estimation with spatial-temporal context and adversarial geometry regularization
.png){kind=icon}
OA
AI
DOI：10.1007/s10489-024-06191-6.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multi-camera depth estimation has gained significant attention in autonomous driving due to its importance in perceiving complex environments. However, extending monocular self-supervised methods to multi-camera setups introduces unique challenges that existing techniques often fail to address. In this paper, we propose STViT+, a novel Transformer-based framework for self-supervised multi-camera depth estimation. Our key contributions include: 1) the Spatial-Temporal Transformer (STTrans), which integrates local spatial connectivity and global context to capture enriched spatial-temporal cross-view correlations, resulting in more accurate 3D geometry reconstruction; 2) the Spatial-Temporal Photometric Consistency Correction (STPCC) strategy that mitigates the impact of varying illumination, ensuring brightness consistency across frames during photometric loss calculation; 3) the Adversarial Geometry Regularization (AGR) module, which employs Generative Adversarial Networks to impose spatial constraints by using unpaired depth maps, enhancing performance under adverse conditions such as rain and nighttime driving. Extensive evaluations on large-scale autonomous driving datasets, including Nuscenes and DDAD, confirm that STViT+ sets a new benchmark for multi-camera depth estimation.
Keyword:
Multi-camera perception
Depth estimation
Spatial-temporal transformer
Adversarial geometry regularization
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
Influence of duration of focal cerebral ischemia and neuronal nitric oxide synthase on translocation of apoptosis-inducing factor to the nucleus.png)
Neuroscience
OAAI
NeuroscienceIF0
OAAI分享收藏分享收藏Unsupervised Learning of Depth Estimation and Camera Pose With Multi-Scale GANs基于多尺度gan的深度估计和相机姿态的无监督学习
PREAI
分享收藏Pressure-Based Bioassay Perceived by a Flexible Pressure Sensor with Synergistic Enhancement of the Photothermal Effect通过具有协同增强光热效应的柔性压力传感器感知的基于压力的生物测定
PREAI
分享收藏
查看更多内容