Point-MPP: Point Cloud Self-Supervised Learning From Masked Position Prediction

Songlin Fan

doi:10.1109/TNNLS.2024.3479309

Point-MPP: Point Cloud Self-Supervised Learning From Masked Position Prediction

2024-01-01

0

PRE

AI

DOI：10.1109/TNNLS.2024.3479309

原文链接

摘要

En 中文

Masked autoencoding has gained momentum for improving fine-tuning performance in many downstream tasks. However, it tends to focus on low-level reconstruction details, lacking high-level semantics and resulting in weak transfer capability. This article presents a novel jigsaw puzzle solver inspired by the idea that predicting the positions of disordered point cloud patches provides more semantic information, similar to how children learn by solving jigsaw puzzles. Our method adopts the mask-then-predict paradigm, erasing the positions of selected point patches rather than their contents. We first partition input point clouds into irregular patches and randomly erase the positions of some patches. Then, a Transformer-based model is used to learn high-level semantic features and regress the positions of the masked patches. This approach forces the model to focus on learning transfer-robust semantics while paying less attention to low-level details. To tie the predictions within the encoding space, we further introduce a consistency constraint on their latent representations to encourage the encoded features to contain more semantic cues. We demonstrate that a standard Transformer backbone with our pretraining scheme can capture discriminative point cloud semantic information. Furthermore, extensive experiments indicate that our method outperforms the previous best competitor across six popular downstream vision tasks, achieving new state-of-the-art performance.

Keyword:

Point cloud compression

Semantics

Transformers

Standards

Feature extraction

Training

Circuit faults

Predictive models

Encoding

Image reconstruction

Masked position prediction

point cloud

pretraining

self-supervised learning (SSL)

Point-MPP: Point Cloud Self-Supervised Learning From Masked Position Prediction

摘要

期刊

机构

引用论文