Collaborative Semantic Understanding and Mapping Framework for Autonomous Systems

Yufeng Yue

doi:10.1109/TMECH.2020.3015054

Return

Collaborative Semantic Understanding and Mapping Framework for Autonomous Systems

2021-04-01

DOI：10.1109/TMECH.2020.3015054

Original

Save

View PDF

Abstract

En 中文

Performing collaborative semantic mapping is a critical challenge for cooperative robots to enhance their comprehensive contextual understanding of the surroundings. This article bridges the gap between the advances in collaborative geometry mapping that relies on pure geometry information fusion, and single robot semantic mapping that focuses on integrating continuous raw sensor data. In this article, a novel hierarchical collaborative probabilistic semantic mapping framework is proposed, where the problem is formulated in a distributed setting. The key novelty of this work is the modeling of the hierarchical semantic map fusion framework and its mathematical derivation of its probability decomposition. At the single robot level, the semantic point cloud is obtained by combining information from heterogeneous sensors and used to generate local semantic maps. At the collaborative robots level, local maps are shared among robots for global semantic map fusion. Since the voxel correspondence is unknown between local maps, an expectation-maximization approach is proposed to estimate the hidden data association. Then, Bayesian rule is applied to perform semantic and occupancy probability update. Experimental results on the unmanned aerial vehicle and the unmanned ground vehicle platforms show the high quality of global semantic maps, demonstrating the accuracy and utility in practical missions.

Keywords:

Semantics

Robot sensing systems

Collaboration

Geometry

Three-dimensional displays

Robot kinematics

Collaborative information fusion

mobile robots

semantic mapping

semantic segmentation

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.