arrow
返回

TSFF: a two-stage fusion framework for 3D object detection

delete2024-08-23
delete0
delete
OA
AI
G
Guoqing Jiang
S
Saiya Li
Z
Ziyu Huang
蔡国榕 封面图
蔡国榕 (Guorong Cai)
苏锦河 封面图
苏锦河 (Jinhe Su) *
DOI:10.7717/peerj-cs.2260delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Point clouds are highly regarded in the field of 3D object detection for their superior geometric properties and versatility. However, object occlusion and defects in scanning equipment frequently result in sparse and missing data within point clouds, adversely affecting the final prediction. Recognizing the synergistic potential between the rich semantic information present in images and the geometric data in point clouds for scene representation, we introduce a two-stage fusion framework (TSFF) for 3D object detection. To address the issue of corrupted geometric information in point clouds caused by object occlusion, we augment point features with image features, thereby enhancing the reference factor of the point cloud during the voting bias phase. Furthermore, we implement a constrained fusion module to selectively sample voting points using a 2D bounding box, integrating valuable image features while reducing the impact of background points in sparse scenes. Our methodology was evaluated on the SUNRGB-D dataset, where it achieved a 3.6 mean average percent (mAP) improvement in the mAP@0.25 evaluation criterion over the baseline. In comparison to other great 3D object detection methods, our method had excellent performance in the detection of some objects.
Keyword:
Point cloud
RGB image
Cross-modal
Object detection
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

PeerJ Computer Science 封面图
PeerJ Computer Science
IF:
2.5
论文数:
3.4K
被引数:
6.9K

机构

J
Jimei University
学者数:
5.0K
论文数: 3.3K
被引数: 4.8K
引用论文

引用论文

Myelination Defects and Neuronal Hyperexcitability in the Neocortex of Connexin 32-deficient Mice
err2000-07-01
err0
PREAI
errB. Sutor; C. Schmolke; B. Teubner; C. Schirmer; K. Willecke
err分享
err收藏
err分享
err收藏
Representations of individuals in ventral temporal cortex defined by faces and biographies
err2013-09-01
err0
errOAAI
errSara C. Verosky; Alexander Todorov; Nicholas B. Turk-Browne
err分享
err收藏
err分享
err收藏
没有更多内容