arrow
Return

Semantic segmentation-assisted instance feature fusion for multi-level 3D part instance segmentation

delete2023-12-01
delete0
delete
OA
AI
S
Sun, Chun-Yu
X
Xin Tong
Y
Yang Liu *
DOI:10.1007/s41095-022-0300-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recognizing 3D part instances from a 3D point cloud is crucial for 3D structure and scene understanding. Several learning-based approaches use semantic segmentation and instance center prediction as training tasks and fail to further exploit the inherent relationship between shape semantics and part instances. In this paper, we present a new method for 3D part instance segmentation. Our method exploits semantic segmentation to fuse nonlocal instance features, such as center prediction, and further enhances the fusion scheme in a multi- and cross-level way. We also propose a semantic region center prediction task to train and leverage the prediction results to improve the clustering of instance points. Our method outperforms existing methods with a large-margin improvement in the PartNet benchmark. We also demonstrate that our feature fusion scheme can be applied to other existing methods to improve their performance in indoor scene instance segmentation tasks.
Keywords:
3D part instance segmentation
feature fusion
3D deep learning

Journal

Computational Visual Media cover
Computational Visual Media
IF:
18.3
Papers:
310
Citations:
2.6K

Organization

T
tsinghua university
Scholars:
11.8W
Papers: 10.0W
Citations: 137
M
Microsoft
Scholars:
3.0K
Papers: 2.7K
Citations: 7