arrow
返回

Masked Structural Point Cloud Modeling to Learning 3D Representation

delete2024-01-01
delete0
delete
OA
AI
R
R Yamada *
R
Ryu Tadokoro
Y
Yue Qiu
K
Kataoka, Hirokatsu
Y
Yutaka Satoh
DOI:10.1109/ACCESS.2024.3470971delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Pre-training for 3D object recognition typically requires a large-scale 3D dataset to learn effective 3D geometric representations. However, constructing such datasets is costly due to the extensive 3D data collection and human annotation required. This paper explores a synthetic pre-training approach that learns 3D geometric representations by reconstructing structural point clouds without relying on real data or human annotation. We propose the Point Cloud Perlin Noise (PCPN) dataset, which is an automatically generated point cloud dataset that uses Perlin noise to simulate natural 3D structures found in the real world. The proposed method enables the rapid generation of diverse 3D geometric patterns using a simple Perlin noise-based formula, significantly reducing the human effort typically involved in creating conventional 3D datasets. We applied PointMAE to the PCPN dataset for pre-training, demonstrating improved performance in downstream tasks such as 3D shape classification and part segmentation. Our experiments showed that the proposed pre-trained model outperformed a model trained from scratch on ModelNet40 by 1.4%. In addition, our pre-training strategy proves effective for 3D object recognition without requiring real data or supervised labels. This study highlights that Perlin noise can capture 3D structural properties and that the diversity of geometric patterns is crucial for learning effective 3D geometric representations.
Keyword:
Deep learning
computer vision
3D object recognition
point cloud
transfer learning
self-supervised learning
formula-driven supervised learning
Deep learning
computer vision
3D object recognition
point cloud
transfer learning
self-supervised learning
formula-driven supervised learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
University of Tsukuba
学者数:
1.8W
论文数: 1.5W
被引数: 1.7W
引用论文

引用论文

A new scheme using the ranked sets
err2018-11-29
err0
PREAI
errMuhammad Noor Ul Amin; Farah Arif; Muhammad Hanif
err分享
err收藏
err分享
err收藏
Intra-Abdominal Splenosis Mimicking Metastatic Cancer
err2011-03-01
err0
PREAI
errNicholas J. Short; Teresa G. Hayes; Peeyush Bhargava
err分享
err收藏
Alternative solid state routes to mixed metal oxides (LnCrO3, LnFeO3)
err1996-06-01
err0
PREAI
errI.P. Parkin; A.V. Komarov; Q. Fang
err分享
err收藏
PRA-Net: Point Relation-Aware Network for 3D Point Cloud Analysis
err2021-01-01
err93
errOAAI
errCheng, Silin; Chen, Xiwu; He, Xinwei; Liu, Zhe; Bai, Xiang
err分享
err收藏
IoT Applications in Agriculture: A Systematic Literature Review
err2018-12-27
err0
PREAI
errRaquel Gómez-Chabla; Karina Real-Avilés; César Morán; Paola Grijalva; Tanya Recalde
err分享
err收藏
学者 查看更多内容