arrow
Return

Improving point cloud classification and segmentation via parametric veronese mapping

delete2023-12-01
delete3
PRE
AI
R
Ruibin Wang
X
Xianghua Ying *
B
Bowei Xing
X
Xin Tong
T
Taiyan Chen
杨锦发 cover
杨锦发 (Jinfa Yang)
史勇杰 (Yongjie Shi)
DOI:10.1016/j.patcog.2023.109784delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep learning based 3D point cloud classification and segmentation has achieved remarkable success. Existing methods are usually implemented in the original space with 3D coordinates as inputs. However, we find that point networks taking only information of first-order coordinates hardly learn geometric features of higher order, such as point cloud normals or poses. In this study, we propose to map the input point clouds into a non-linear space to facilitate networks learning and leveraging high-order features. Firstly, we design the Parametric Veronese Mapping (PVM) function which automatically learns to map point clouds into a non-linear space. As a result, the mapped point clouds are enriched with high-order elements and maintain the basic point set properties as in the original 3D space. We can then exploit existing networks to learn high-order features from mapped point clouds. Secondly, we contribute a two-stage transformation learning module that modifies the previous one-stage module to better leverage high-order features for aligning point clouds in the projective space. Finally, an interaction module is designed to learn more discriminative features by aggregating information from both the original and projective space. Extensive experiments demonstrate that our method successfully improves the ability of most existing networks to learn high-order features and thus contributing to more accurate classification and segmentation. Moreover, the resulting models show stronger robustness to affine transformations and real-world perturbations.
Keywords:
3D Point cloud
Deep learning
Non-linear space mapping
Shape classification
Part segmentation
Semantic segmentation

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

P
peking university
Scholars:
11.8W
Papers: 8.7W
Citations: 146