arrow
Return

Point2Seq: Quantized Serialization Encoding for Object Point Cloud Pretraining

delete2026-05-26
delete0
PRE
AI
X
Xumin Yu
刘祖岩 (Zuyan Liu)
J
Jie Zhou
J
Jiwen Lu *
DOI:10.1007/s11263-026-02884-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Point clouds, as an unstructured set of points, have emerged as a crucial data format in modern 3D deep learning tasks, facilitating applications ranging from object recognition to scene understanding. However, traditional point cloud encoding methods grounded in voxelization or grouping strategies often suffer from inefficiencies and ambiguities during local point cloud processing. These limitations can hinder the extraction of fine-grained features and impact the overall performance of 3D learning models. Notably, compact representations, such as the neural field representation employed in 3D shape reconstruction, have demonstrated remarkable capabilities in capturing the structural integrity and intricate details of 3D objects. Nevertheless, the utilization of these advanced representations in discriminative tasks remains largely unexplored territory. In response to these challenges and opportunities, we propose Point2Seq, a novel point cloud encoding method. Point2Seq constructs a new representation of point clouds by leveraging serialized and discrete encoding techniques. This approach transforms point clouds into a grid-based format, which not only enables efficient spatial interpolation but also facilitates the expansion of the receptive field for downstream tasks, thereby enhancing the model’s ability to capture context and spatial relationships. To comprehensively assess the effectiveness of Point2Seq, we conduct extensive evaluations on a diverse set of canonical object-level point cloud benchmarks. Our experiments cover a wide spectrum of tasks, including low-level tasks like point cloud completion, high-level tasks such as classification and part segmentation, as well as few-shot learning scenarios. The results demonstrate that Point2Seq achieves state-of-the-art performance across these tasks. Additionally, the reduced noise in the input data allows our representation to converge more rapidly during downstream task training, further underscoring its superiority. The code for Point2Seq will be publicly released to promote reproducibility and further research in this area.
Keywords:
Point cloud encoding
Neural field representation
Spatial interpolation
Object-level benchmarks
Few-shot learning

Journal

International Journal of Computer Vision cover
International Journal of Computer Vision
IF:
9.3
Papers:
3.9K
Citations:
2.8W

Organization

T
tsinghua university
Scholars:
11.7W
Papers: 10.0W
Citations: 137