arrow
Return

INF-PCA: Implicit Neural Field-Based Interactive Point Cloud Semantic Annotation

delete2025-02-01
delete0
PRE
AI
C
Chong Liu
X
Xu Han
W
Weihong Huang
L
Long Chen
W
Wang Wang
Z
Zhen Dong
B
Bisheng Yang *
DOI:10.1109/TITS.2024.3496938delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Point cloud semantic segmentation helps Intelligent Transportation Systems understand traffic scenes by assigning semantic label to each point in the point cloud, and it relies on large amounts of annotated training data. Nevertheless, manually annotating large-scale datasets of complex traffic scenes is quite time-consuming and tedious. This paper proposes INF-PCA, an interactive point cloud semantic annotation method based on implicit neural field, which allows users to achieve high-quality, large-scene and fast-response semantic annotation with only a few dozen mouse clicks. Firstly, the appearance, geometry and semantics of the point clouds are jointly represented by an implicit neural field, which maps a 3D spatial coordinate to its corresponding attributes. Secondly, an uncertainty-based semantic entropy loss and a supervoxel-based local consistency loss are designed to force the network to produce deterministic predictions with local consistency, thus generating smoother and more accurate boundaries. Furthermore, an active learning-based strategy for click-free annotation is proposed and analyzed to further reduce annotation pressure. Comprehensive experiments on multiple datasets including the road scene dataset Toronto3D revealed that INF-PCA can achieve more accurate annotations with faster response speed and only half of the clicks employed by the state-of-the-art methods, and that INF-PCA can be directly applied to intelligent transportation applications such as interactive segmentation of road scenes, inventory of transportation infrastructure assets, and production of high-definition map.
Keywords:
Annotations
Semantics
Point cloud compression
Geometry
Three-dimensional displays
Accuracy
Transportation
Semantic segmentation
Human computer interaction
Roads
Point clouds
interactive annotation
neural field
digital twin transportation

Journal

IEEE Transactions on Intelligent Transportation Systems cover
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
Papers:
9.7K
Citations:
6.3W

Organization

U
University of Hong Kong
Scholars:
4.1W
Papers: 3.9W
Citations: 10.1W
W
wuhan university
Scholars:
8.1W
Papers: 5.8W
Citations: 70
Cited Papers

Cited Papers

Vestibular and Balance Rehabilitation Therapy
err1993-03-01
err0
PREAI
errNeil T. Shepard; Michael Smith-Wheelock; Steven A. Telian; Anil Raj
errShare
errSave
SETBP1 mutations in two Thai patients with Schinzel-Giedion syndrome
err2011-03-04
err0
PREAI
errK Suphapeetiporn; C Srichomthong; V Shotelersuk
errShare
errSave
LabelMe: A database and web-based tool for image annotation
err2007-10-31
err2.7K
PREAI
errRussell, Bryan C.; Torralba, Antonio; Murphy, Kevin P.; Freeman, William T.
errShare
errSave
DETERMINATION OF FIXED AMMONIUM IN SOILS
err1958-12-01
err0
PREAI
errA. P. S. DHARIWAL; F. J. STEVENSON
errShare
errSave
PV-EncoNet: Fast Object Detection Based on Colored Point Cloud
err2022-08-01
err10
PREAI
errOuyang, Zhenchao; Dong, Xiaoyun; Cui, Jiahe; Niu, Jianwei; Guizani, Mohsen
errShare
errSave
SemanticPaint: Interactive 3D Labeling and Learning at your Fingertips
err2015-11-03
err92
errOAAI
errValentin, Julien; Vineet, Vibhav; Cheng, Ming-Ming; Kim, David; Shotton, Jamie; Kohli, Pushmeet; Niessner, Matthias; Criminisi, Antonio; Izadi, Shahram; Torr, Philip
errShare
errSave
Parallel Driving OS: A Ubiquitous Operating System for Autonomous Driving in CPSS
err2022-12-01
err84
PREAI
errChen, Long; Zhang, Yunqing; Tian, Bin; Ai, Yunfeng; Cao, Dongpu; Wang, Fei-Yue
errShare
errSave
SAnE: Smart Annotation and Evaluation Tools for Point Cloud Data
err2020-01-01
err12
errOAAI
errArief, Hasan Asy'ari; Arief, Mansur; Zhang, Guilin; Liu, Zuxin; Bhat, Manoj; Indahl, Ulf Geir; Tveite, Havard; Zhao, Ding
errShare
errSave
Relationship between the fixed ammonium and the mineralization of the organic nitrogen in soil
err1996-01-01
err0
PREAI
errA. Benedetti; L. Vittori Antisari; S. Canali; P. Gioacchini; P. Sequi
errShare
errSave
researcher View more