arrow
返回

S2CNet: Semantic and Structure Completion Network for 3D Object Detection

delete2024-11-01
delete0
PRE
AI
张
张重阳 (Chongyang Zhang) *
Y
Yan Luo
Z
Zefeng Qian
M
Muming Zhao
DOI:10.1109/TITS.2024.3429139delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
LiDAR has become one of the primary 3D object detection sensors in autonomous driving. However, due to the inherent sparsity of point clouds, certain objects exhibit structure incompleteness in occluded and distant areas, which hampers the accurate perception of objects in 3D space. To tackle this challenge, we propose Semantic and Structure Completion Network (S(2)CNet) for 3D object detection. Concretely, we design the Semantic Completion (SeC) module to generate semantic features in Bird's-Eye-View (BEV) space, utilizing a teacher-student paradigm. Notably, we adopt a coarse-to-fine guidance strategy to encourage student network to generate semantic features specifically within foreground regions. This ensures that the student network focuses on the generation of foreground object features. Besides, we introduce an attention-based module to adaptively fuse the generated features and raw features. SeC module faces particular limitation when dealing with objects containing only a few points, in such case, the network is prone to generating low quality proposals with inaccurate localization. Complementary to SeC module, we introduce the Structure Completion (StC) module, in which a group of structural proposals are obtained by traversing most structures in a structure-guided manner, and thus at least one proposal with ground truth similar structure can be guaranteed. Extensive experiments on the KITTI and nuScenes benchmarks demonstrate the effectiveness of our method, especially for the hard setting objects with fewer points.
Keyword:
Feature extraction
Semantics
Proposals
Three-dimensional displays
Point cloud compression
Detectors
Object detection
3D object detection
point cloud
feature completion
autonomous driving

期刊

IEEE Transactions on Intelligent Transportation Systems 封面图
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
论文数:
9.7K
被引数:
6.3W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
B
beijing forestry university
学者数:
1.9W
论文数: 1.1W
被引数: 3
引用论文

引用论文

The myeloma cell antigen syndecan‐1 is lost by apoptotic myeloma cells
err2001-12-25
err0
errOAAI
errMichel Jourdan; Martine Ferlin; Eric Legouffe; Mira Horvathova; Janny Liautard; Jean FranÇois Rossi; John Wijdenes; Jean Brochier; Bernard Klein
err分享
err收藏
3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images基于点云与图像多级融合的三维车辆检测
err2022-09-01
err22
PREAI
errZhao, Kun; Ma, Lingfei; Meng, Yu; Liu, Li; Wang, Junbo; Marcato, Jose, Jr.; Goncalves, Wesley Nunes; Li, Jonathan
err分享
err收藏
err分享
err收藏
学者 查看更多内容