arrow
Return

Adaptive token selection for scalable point cloud transformers

delete2025-05-27
delete0
delete
OA
AI
A
Alessandro Baiocchi
I
Indro Spinelli
A
Alessandro Nicolosi
S
Simone Scardapane *
DOI:10.1016/j.neunet.2025.107477delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The recent surge in 3D data acquisition has spurred the development of geometric deep learning models for point cloud processing, boosted by the remarkable success of transformers in natural language processing. While point cloud transformers (PTs) have achieved impressive results recently, their quadratic scaling with respect to the point cloud size poses a significant scalability challenge for real-world applications. To address this issue, we propose the Adaptive Point Cloud Transformer (AdaPT), a standard PT model augmented by an adaptive token selection mechanism. AdaPT dynamically reduces the number of tokens during inference, enabling efficient processing of large point clouds. Furthermore, we introduce a budget mechanism to flexibly adjust the computational cost of the model at inference time without the need for retraining or fine-tuning separate models. Our extensive experimental evaluation on point cloud classification tasks demonstrates that AdaPT significantly reduces computational complexity while maintaining competitive accuracy compared to standard PTs. The code for AdaPT is publicly available at https://github.com/ispamm/adaPT.
Keywords:
Transformer
Geometric deep learning
Point clouds
Gumbel-Softmax
Token selection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.2K
Citations:
3.0W

Organization

L
leonardo labs
Scholars:
4
Papers: 2
Citations: 0
S
sapienza university rome
Scholars:
6.3W
Papers: 4.7W
Citations: 381
Cited Papers

Cited Papers

A Survey on Transformers for Point Cloud Processing: An Updated Overview
err2022-01-01
err7
PREAI
errZeng, Jiahao; Wang, Decheng; Chen, Peng
errShare
errSave
PCT: Point cloud transformer
err2021-06-01
err1.0K
errOAAI
errGuo, Meng-Hao; Cai, Jun-Xiong; Liu, Zheng-Ning; Mu, Tai-Jiang; Martin, Ralph R.; Hu, Shi-Min
errShare
errSave
Recent Advancements in Learning Algorithms for Point Clouds: An Updated Overview
errSENSORS
IF3.5
err2022-02-10
err44
errOAAI
errCamuffo, Elena; Mari, Daniele; Milani, Simone
errShare
errSave
Point cloud modeling as a bridge between landscape design and planning
err2020-11-01
err39
errOAAI
errUrech, Philipp R. W.; Dissegna, Maria Angela; Girot, Christophe; Gret-Regamey, Adrienne
errShare
errSave
Semantic segmentation using Vision Transformers: A survey
err2023-11-01
err0
errOAAI
errHans Thisanke; Chamli Deshan; Kavindu Chamith; Sachith Seneviratne; Rajith Vidanaarachchi; Damayanthi Herath
errShare
errSave
Deep Learning for 3D Point Clouds: A Survey
err2021-12-01
err0
errOAAI
errYulan Guo; Hanyun Wang; Qingyong Hu; Hao Liu; Li Liu; Mohammed Bennamoun
errShare
errSave
A comprehensive survey on applications of transformers for deep learning tasks
err2024-05-01
err47
errOAAI
errIslam, Saidul; Elmekki, Hanae; Elsebai, Ahmed; Bentahar, Jamal; Drawel, Nagat; Rjoub, Gaith; Pedrycz, Witold
errShare
errSave
Assessing the visibility of urban greenery using MLS LiDAR data
err2023-04-01
err0
PREAI
errLiyu Tang; Jianguo He; Wei Peng; Hongyu Huang; Chongcheng Chen; Can Yu
errShare
errSave
Modeling Point Clouds With Self-Attention and Gumbel Subset Sampling
err2019-06-01
err0
errOAAI
errJiancheng Yang; Qiang Zhang; Bingbing Ni; Linguo Li; Jinxian Liu; Mengdie Zhou; Qi Tian
errShare
errSave
researcher View more