arrow
Return

Multi-Head Self-Attention for 3D Point Cloud Classification

delete2021-01-01
delete12
delete
OA
AI
X
Xue-Yao Gao
Y
Yanzhao Wang
张春祥 cover
张春祥 (Chunxiang Zhang) *
J
Jiaqi Lu
DOI:10.1109/ACCESS.2021.3050488delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
3D point cloud classification is a hot issue in recent years. 3D point cloud is different from regular data such as image and text. Disorder of point cloud makes two-dimensional (2D) convolution neural network (CNN) hard to be applied. When features are acquired from input data, it is important to extract global and local information effectively. In this paper, we propose a 3D model classification method based on multi-head self-attention mechanism which consumes sparse point clouds and learns robust latent representation of 3D point cloud. The framework is composed of self-attention layer, multilayer perceptrons (MLPs), fully connected (FC) layer, max-pooling layer and softmax layer. Feature vector of point includes spatial coordinates and shape descriptors, and they are encoded by self-attention layers to extract relationships among them. Outputs of attention layers are concatenated and put into MLPs to extract features. When they are transformed into the expected dimension by MLPs, max-pooling layer will be applied to get features in high level. Then, they are put into fully connected layer. Softmax layer is used to determine category of 3D model. The proposed method is applied to ModelNet40. Experimental results show that the proposed method is robust to rotation variance, position variance and point sparsity.
Keywords:
Three-dimensional displays
Feature extraction
Shape
Solid modeling
Computational modeling
Surface fitting
Data mining
INDEX TERMS point cloud
convolutional neural network
self-attention mechanism
feature vector
spatial coordinates
shape descriptor
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

N
northeast agricultural university - china
Scholars:
1.5W
Papers: 8.1K
Citations: 13