arrow
Return

EfficientLPS: Efficient LiDAR Panoptic Segmentation

delete2022-06-01
delete51
delete
OA
AI
K
Kshitij Sirohi *
R
Rohit Mohan
B
Buescher, Daniel
W
Wolfram Burgard
A
Abhinav Valada
DOI:10.1109/TRO.2021.3122069delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Panoptic segmentation of point clouds is a crucial task that enables autonomous vehicles to comprehend their vicinity using their highly accurate and reliable LiDAR sensors. Existing top-down approaches tackle this problem by either combining independent task-specific networks or translating methods from the image domain ignoring the intricacies of LiDAR data and thus often resulting in suboptimal performance. In this article, we present the novel top-down efficient LiDAR panoptic segmentation (EfficientLPS) architecture that addresses multiple challenges in segmenting LiDAR point clouds, including distance-dependent sparsity, severe occlusions, large scale-variations, and reprojection errors. EfficientLPS comprises of a novel shared backbone that encodes with strengthened geometric transformation modeling capacity and aggregates semantically rich range-aware multiscale features. It incorporates new scale-invariant semantic and instance segmentation heads along with the panoptic fusion module which is supervised by our proposed panoptic periphery loss function. Additionally, we formulate a regularized pseudolabeling framework to further improve the performance of EfficientLPS by training on unlabeled data. We benchmark our proposed model on two large-scale LiDAR datasets: nuScenes, for which we also provide ground truth annotations, and SemanticKITTI. Notably, EfficientLPS sets the new state-of-the-art on both these datasets.
Keywords:
Laser radar
Image segmentation
Semantics
Task analysis
Phase change materials
Convolutional codes
Solid modeling
Instance segmentation
panoptic segmentation
scene understanding
semantic segmentation

Journal

IEEE Transactions on Robotics cover
IEEE Transactions on Robotics
IF:
10.5
Papers:
3.3K
Citations:
2.8W

Organization

U
University of Freiburg
Scholars:
3.3W
Papers: 2.4W
Citations: 3.4W