arrow
Return

A Click-Based Interactive Segmentation Network for Point Clouds

delete2023-01-01
delete3
PRE
AI
W
Wentao Sun
Z
Zhipeng Luo
Y
Yiping Chen *
H
Huxiong Li
J
José Marcato
W
Wesley Nunes Gonéalves
J
Jonathan Li *
DOI:10.1109/TGRS.2023.3323735delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Interactive segmentation plays an essential role in several tasks involving point clouds. However, existing methods suffer from low segmentation accuracy and cannot adjust the segmentation results according to the user's personal demands. This article presents a novel deep-learning (DL)-based interactive segmentation method, named click rough segmentation network (CRSNet), designed to handle point clouds. The method allows users to iteratively click to segment interesting objects. CRSNet consists of two key parts: a click rough segmentation (CRS) module and a feature extraction module. First, the CRS module transforms click operations into an appropriate representation to input into the feature extraction module. The CRS module takes raw point clouds and clicks operations as input and outputs 3-D Gaussian vectors and roughly segmented blocks, which adapt to different-sized and densely distributed objects in complex environments. Second, the feature extraction module, which uses a novel mix loss-based analysis algorithm, extracts deep features and obtains instance segmentation results. The module is highly compatible because its backbones can be replaced by different DL architectures. Experimental results on the Karlsruhe Institute of Technology and Toyota Technological Institute (KITTI), Apolloscape, Roadmarking, Scannet, and SemanticKITTI datasets show that our method outperforms state-of-the-art semantic segmentation methods with one click. Moreover, our method can generalize well to unseen objects and datasets.
Keywords:
Deep learning
Deep learning (DL)
instance segmentation
interactive segmentation
point clouds

Journal

IEEE Transactions on Geoscience and Remote Sensing cover
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
Papers:
2.1W
Citations:
10.7W

Organization

M
Minnan Normal University
Scholars:
2.1K
Papers: 1.3K
Citations: 0
S
Sun Yat Sen University
Scholars:
9.9W
Papers: 7.2W
Citations: 95
S
shaoxing university
Scholars:
5.6K
Papers: 3.6K
Citations: 88
Universidade Federal de Mato Grosso do Sul cover
Universidade Federal de Mato Grosso do Sul
Scholars:
4.5K
Papers: 2.6K
Citations: 2.1K
U
University of Waterloo
Scholars:
2.2W
Papers: 2.3W
Citations: 3.3W
researcher View more organizations