arrow
返回

3DCTN: 3D Convolution-Transformer Network for Point Cloud Classification

delete2022-12-01
delete47
delete
OA
AI
D
Dening Lu
谢
谢谦 (Qian Xie)
K
Kyle Gao
L
Linlin Xu
J
Jonathan Li *
DOI:10.1109/TITS.2022.3198836delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Point cloud classification is a fundamental task in 3D applications. However, it is challenging to achieve effective feature learning due to the irregularity and unordered nature of point clouds. Lately, 3D Transformers have been adopted to improve point cloud processing. Nevertheless, massive Transformer layers tend to incur huge computational and memory costs. This paper presented a novel hierarchical framework that incorporated convolutions with Transformers for point cloud classification, named 3D Convolution-Transformer Network (3DCTN). It combined the strong local feature learning ability of convolutions with the remarkable global context modeling capability of Transformers. Our method had two main modules operating on the downsampling point sets. Each module consisted of a multi-scale local feature aggregating (LFA) block and a global feature learning (GFL) block, which were implemented by using the Graph Convolution and Transformer respectively. We also conducted a detailed investigation on a series of self-attention variants to explore better performance for our network. Various experiments on ModelNet40 and ScanObjectNN datasets demonstrated that our method achieves state-of-the-art classification performance with a lightweight design. The code is publicly available at https://github.com/d62lu/3DCTN.
Keyword:
Transformers
Point cloud compression
Three-dimensional displays
Feature extraction
Representation learning
Convolutional codes
Costs
Transformer
convolution-transformer
hierarchical transformer
point cloud classification
deep learning
self-attention mechanism
graph convolution

期刊

IEEE Transactions on Intelligent Transportation Systems 封面图
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
论文数:
9.7K
被引数:
6.3W

机构

U
university of oxford
学者数:
9.8W
论文数: 8.6W
被引数: 137
U
University of Waterloo
学者数:
2.2W
论文数: 2.3W
被引数: 3.3W
引用论文

引用论文

Figurale Nachwirkungen
err1966-01-01
err0
PREAI
errM. K. Malhotra
err分享
err收藏
Point Convolutional Neural Networks by Extension Operators
err2018-07-30
err288
errOAAI
errAtzmon, Matan; Maron, Haggai; Lipman, Yaron
err分享
err收藏
PCT: Point cloud transformerPCT: 点云变压器
err2021-06-01
err1.0K
errOAAI
errGuo, Meng-Hao; Cai, Jun-Xiong; Liu, Zheng-Ning; Mu, Tai-Jiang; Martin, Ralph R.; Hu, Shi-Min
err分享
err收藏
err分享
err收藏
Automatic Instrument Segmentation in Robot-Assisted Surgery Using Deep Learning
err
IF0
err2018-03-03
err0
errOAAI
errAlexey A. Shvets; Alexander Rakhlin; Alexandr A. Kalinin; Vladimir I. Iglovikov
err分享
err收藏
学者 查看更多内容