arrow
Return

ODSPC: deep learning-based 3D object detection using semantic point cloud

delete2023-03-18
delete2
PRE
AI
S
Shuang Song
T
Tengchao Huang
Q
Qingyuan Zhu *
H
Huosheng Hu
DOI:10.1007/s00371-023-02820-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Three-dimensional object detection plays a key role in autonomous driving, which becomes extremely challenging in occlusion situations. This paper presents a novel multimodal 3D object detection framework which fuses visual semantic information and depth point cloud information to accurately detect targets with distant object features and occlusion situations. The framework consists of the four steps. Firstly, an improved semantic segmentation network is used to extract semantic information of objects containing similar features. Secondly, semantic images and point clouds are combined to generate pixel-level fusion data so that the semantic information and training capability of sparse and far-point clouds can be improved. Thirdly, a deep learning-based point cloud classification network is used for training of the fused data to output accurate detection frames. Fourthly, an extended Kalman filter is incorporated into point cloud prediction for image-based object detection to further enhance the robustness of object detection. Both Cityscapes and KITTI datasets are used in ablation study and experiments to validate the effectiveness of the proposed framework.
Keywords:
Object detection
Semantic segmentation
Point cloud classification
Fused data
Extended Kalman filter

Journal

Visual Computer cover
Visual Computer
IF:
2.9
Papers:
4.6K
Citations:
6.5K

Organization

U
University of Essex
Scholars:
4.0K
Papers: 4.8K
Citations: 5
X
xiamen university
Scholars:
5.9W
Papers: 3.8W
Citations: 67
Cited Papers

Cited Papers

The myeloma cell antigen syndecan‐1 is lost by apoptotic myeloma cells
err2001-12-25
err0
errOAAI
errMichel Jourdan; Martine Ferlin; Eric Legouffe; Mira Horvathova; Janny Liautard; Jean FranÇois Rossi; John Wijdenes; Jean Brochier; Bernard Klein
errShare
errSave
Vote-Based 3D Object Detection with Context Modeling and SOB-3DNMS
err2021-04-01
err20
errOAAI
errXie, Qian; Lai, Yu-Kun; Wu, Jing; Wang, Zhoutao; Zhang, Yiming; Xu, Kai; Wang, Jun
errShare
errSave
Reporting bias in the literature on the associations of health-related behaviors and statins with cardiovascular disease and all-cause mortality
err2018-06-18
err0
errOAAI
errLeandro Fórnias Machado de Rezende; Juan Pablo Rey-López; Thiago Hérick de Sá; Nicholas Chartres; Alice Fabbri; Lauren Powell; Emmanuel Stamatakis; Lisa Bero
errShare
errSave
Key Aspects of Nucleic Acid Library Design for in Vitro Selection
err2018-02-05
err0
errOAAI
errMaria Vorobyeva; Anna Davydova; Pavel Vorobjev; Dmitrii Pyshnyi; Alya Venyaminova
errShare
errSave
err2011-06-01
err0
PREAI
err
errShare
errSave
researcher View more