arrow
Return

Deep learning with simulated laser scanning data for 3D point cloud classification

delete2024-09-01
delete1
delete
OA
AI
E
Esmoris, Alberto M.
H
Hannah Weiser
L
Lukas Winiwarter
C
Cabaleiro, Jose C.
B
Bernhard Höfle *
DOI:10.1016/j.isprsjprs.2024.06.018delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Laser scanning is an active remote sensing technique applied in many disciplines to acquire state-of-the-art spatial measurements. Semantic labeling is often necessary to extract information from the raw point cloud. Deep learning methods constitute a data-hungry solution for the semantic segmentation of point clouds. In this work, we investigate the use of simulated laser scanning for training deep learning models, which are applied to real data subsequently. We show that training a deep learning model purely on virtual laser scanning data can produce results comparable to models trained on real data when evaluated on real data. For leaf-wood segmentation of trees, using the KPConv model trained with virtual data achieves 93.7% overall accuracy, while the model trained on real data reaches 94.7% overall accuracy. In urban contexts, a KPConv model trained on virtual data achieves 74.1% overall accuracy on real validation data, while the model trained on real data achieves 82.4%. Our models outperform the state-of-the-art model FSCT in terms of generalization to unseen real data as well as a baseline model trained on points randomly sampled from the tree mesh surface. From our results, we conclude that the combination of laser scanning simulation and deep learning is a cost-effective alternative to real data acquisition and manual labeling in the domain of geospatial point cloud analysis. The strengths of this approach are that (a) a large amount of diverse laser scanning training data can be generated quickly and without the need for expensive equipment, (b) the simulation configurations can be adapted so that the virtual training data have similar characteristics to the targeted real data, and (c) the whole workflow can be automated through procedural scene generation.
Keywords:
Virtual laser scanning
LiDAR simulation
Point clouds
Machine learning
Point-wise classification
Leaf-wood segmentation

Journal

ISPRS Journal of Photogrammetry and Remote Sensing cover
ISPRS Journal of Photogrammetry and Remote Sensing
IF:
12.2
Papers:
4.4K
Citations:
3.2W

Organization

R
Ruprecht Karls University Heidelberg
Scholars:
5.6W
Papers: 4.3W
Citations: 66
U
Universidade de Santiago de Compostela
Scholars:
1.5W
Papers: 1.3W
Citations: 1.4W
Cited Papers

Cited Papers

Opaque voxel-based tree models for virtual laser scanning in forestry applications
err2021-11-01
err19
errOAAI
errWeiser, Hannah; Winiwarter, Lukas; Anders, Katharina; Fassnacht, Fabian Ewald; Hoefle, Bernhard
errShare
errSave
An automated approach for wood-leaf separation from terrestrial LIDAR point clouds using the density based clustering algorithm DBSCAN
err2018-11-01
err91
PREAI
errFerrara, Roberto; Virdis, Salvatore G. P.; Ventura, Andrea; Ghisu, Tiziano; Duce, Pierpaolo; Pellizzaro, Grazia
errShare
errSave
Individual tree point clouds and tree measurements from multi-platform laser scanning in German forests
err2022-07-05
err46
errOAAI
errWeiser, Hannah; Schaefer, Jannika; Winiwarter, Lukas; Krasovec, Nina; Fassnacht, Fabian E.; Hoefle, Bernhard
errShare
errSave
SBA-15:TiO2 nanocomposites: II. Direct and post-synthesis using acetylacetone
err2017-02-01
err0
PREAI
errAlice A.M.L.F. Jardim; Rebeca Bacani; Norberto S. Gonçalves; Márcia C.A. Fantini; Tereza S. Martins
errShare
errSave
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
researcher View more