.png){kind=icon}
返回
Deep Sparse Depth Completion Using Multi-Scale Residuals and Channel Shuffle
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2024.3353048.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Depth completion aims to recover dense depth maps from sparse depth maps. Recent approaches have used additional modalities as guidance to improve depth completion performance. Image-guided depth completion uses scene information from color images, but it still produces inaccurate object boundaries. In this paper, we propose deep sparse depth completion using multi-scale residuals and channel shuffle, named ReCSNet. ReCSNet is a dual-branch network based on a U-shaped architecture. ReCSNet consists of one VIS-Semantic-Guided Branch (VSGB) and one Sparse Depth Guided Branch (SDGB) to get global color, edge information, and local accurate depth information. VSGB utilizes two encoders to extract features from the VIS-Semantic image pairs and the sparse depth maps, and employs a feature channel shuffle mechanism to blend the two sets of encoded features. The semi-dense depth map generated by VSGB is concatenated with the original sparse depth map and input into SDGB to predict the second semi-dense depth map. The confidence maps generated by the two branches are adaptively fused to generate the final depth map. Moreover, we incorporate multi-scale residuals obtained from the VIS image and concatenate them with the decoded features to further enhance the constraint on object boundaries. At the rear of the dual-branch network, we add a Repetitive Deformable Convolution Module (RDCM) to further refine the depth values in object edges. Experimental results show that ReCSNet achieves outstanding performance on the KITTI depth completion validation dataset with an improvement of 16mm in the root mean square error (RMSE) metric.
Keyword:
Depth completion
channel shuffle
deformable convolution
multi-scale residuals
semantic segmentation
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Wider or Deeper: Revisiting the ResNet Model for Visual Recognition更广泛或更深入: 重新审视视觉识别的ResNet模型.png)
PATTERN RECOGNITION
OAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏分享收藏An Overview of the Stratospheric Observatory for Infrared Astronomy Since Full Operation Capability
PREAI
分享收藏
查看更多内容