arrow
返回

Position-Guided Point Cloud Panoptic Segmentation Transformer

delete2024-07-27
delete2
PRE
AI
Z
Zeqi Xiao
W
Wenwei Zhang
T
Tai Wang
C
Chen Change Loy
D
Dahua Lin
J
Jiangmiao Pang *
DOI:10.1007/s11263-024-02162-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
DEtection TRansformer (DETR) started a trend that uses a group of learnable queries for unified visual perception. This work begins by applying this appealing paradigm to LiDAR-based point cloud segmentation and obtains a simple yet effective baseline. Although the naive adaptation obtains fair results, the instance segmentation performance is noticeably inferior to previous works. By diving into the details, we observe that instances in the sparse point clouds are relatively small to the whole scene and often have similar geometry but lack distinctive appearance for segmentation, which are rare in the image domain. Considering instances in 3D are more featured by their positional information, we emphasize their roles during the modeling and design a robust Mixed-parameterized Positional Embedding (MPE) to guide the segmentation process. It is embedded into backbone features and later guides the mask prediction and query update processes iteratively, leading to Position-Aware Segmentation (PA-Seg) and Masked Focal Attention (MFA). All these designs impel the queries to attend to specific regions and identify various instances. The method, named Position-guided Point cloud Panoptic segmentation transFormer (P3Former), outperforms previous state-of-the-art methods by 2.7% and 1.2% PQ on SemanticKITTI and nuScenes datasets, respectively. The source code and models are available at https://github.com/OpenRobotLab/P3Former.
Keyword:
Panoptic segmentation
Point cloud
Unified
Position guidance

期刊

International Journal of Computer Vision 封面图
International Journal of Computer Vision
IF:
9.3
论文数:
3.9K
被引数:
2.8W

机构

S
Shanghai Artificial Intelligence Laboratory
学者数:
475
论文数: 261
被引数: 765
N
Nanyang Technological University
学者数:
4.9W
论文数: 4.8W
被引数: 8.1W
C
Chinese University of Hong Kong
学者数:
3.4W
论文数: 3.2W
被引数: 5.6W
学者 查看更多机构
引用论文

引用论文

Systematic review of systematic reviews of non-pharmacological interventions to treat behavioural disturbances in older patients with dementia. The SENATOR-OnTop series
err2017-03-16
err0
errOAAI
errIosief Abraha; Joseph M Rimland; Fabiana Mirella Trotta; Giuseppina Dell'Aquila; Alfonso Cruz-Jentoft; Mirko Petrovic; Adalsteinn Gudmundsson; Roy Soiza; Denis O'Mahony; Antonio Guaita; Antonio Cherubini
err分享
err收藏
err分享
err收藏
err分享
err收藏
Ideal topological phononic nodal chain in K2O materials class
err2021-10-27
err0
errOAAI
errY S Chen; F F Huang; P Zhou; Z S Ma; L Z Sun
err分享
err收藏
A STUDY ON THE CAUSES OF STRATEGIES FAILING TO SUCCESS
err2009-12-15
err0
errOAAI
errMehmet Ali KÖSEOĞLU; Mehmet BARCA; Kemal KARAYORMUK
err分享
err收藏
Total Excess Mortality Surveillance for Real-Time Decision-Making in Disasters and Crises
err2023-03-13
err0
errOAAI
errCarlos Santos-Burgoa; Alejandra Garcia-Meza; Maria Jose Talayero; Nolan Kuenster; Ann S. Goldman Hawes; Elizabeth Andrade
err分享
err收藏
学者 查看更多内容