.png){kind=icon}
返回
Camera-Based 3D Semantic Scene Completion With Sparse Guidance Network
.png){kind=icon}
PRE
AI
DOI：10.1109/TIP.2024.3461989.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Semantic scene completion (SSC) aims to predict the semantic occupancy of each voxel in the entire 3D scene from limited observations, which is an emerging and critical task for autonomous driving. Recently, many studies have turned to camera-based SSC solutions due to the richer visual cues and cost-effectiveness of cameras. However, existing methods usually rely on sophisticated and heavy 3D models to process the lifted 3D features directly, which are not discriminative enough for clear segmentation boundaries. In this paper, we adopt the dense-sparse-dense design and propose a one-stage camera-based SSC framework, termed SGN, to propagate semantics from the semantic-aware seed voxels to the whole scene based on spatial geometry cues. Firstly, to exploit depth-aware context and dynamically select sparse seed voxels, we redesign the sparse voxel proposal network to process points generated by depth prediction directly with the coarse-to-fine paradigm. Furthermore, by designing hybrid guidance (sparse semantic and geometry guidance) and effective voxel aggregation for spatial geometry cues, we enhance the feature separation between different categories and expedite the convergence of semantic propagation. Finally, we devise the multi-scale semantic propagation module for flexible receptive fields while reducing the computation resources. Extensive experimental results on the SemanticKITTI and SSCBench-KITTI-360 datasets demonstrate the superiority of our SGN over existing state-of-the-art methods. And even our lightweight version SGN-L achieves notable scores of 14.80% mIoU and 45.45% IoU on SeamnticKITTI validation with only 12.5 M parameters and 7.16 G training memory. Code is available at https://github.com/Jieqianyu/SGN.
Keyword:
Three-dimensional displays
Semantics
Geometry
Feature extraction
Solid modeling
Proposals
Cameras
Convergence
Autonomous vehicles
Visualization
Semantic scene completion
sparse guidance network
hybrid guidance
voxel aggregation
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现.png)
Indoor Air
OAAI
Indoor AirIF0
OAAI分享收藏Constrained H∞ control of active suspension for a half-car model with a time delay in controlProceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering
Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile EngineeringIF0
PREAI
分享收藏Myelination Defects and Neuronal Hyperexcitability in the Neocortex of Connexin 32-deficient Mice
PREAI
分享收藏
查看更多内容