Return
Collaborative Semantic Understanding and Mapping Framework for Autonomous Systems
DOI:10.1109/TMECH.2020.3015054.png)
Abstract
En 中文
Performing collaborative semantic mapping is a critical challenge for cooperative robots to enhance their comprehensive contextual understanding of the surroundings. This article bridges the gap between the advances in collaborative geometry mapping that relies on pure geometry information fusion, and single robot semantic mapping that focuses on integrating continuous raw sensor data. In this article, a novel hierarchical collaborative probabilistic semantic mapping framework is proposed, where the problem is formulated in a distributed setting. The key novelty of this work is the modeling of the hierarchical semantic map fusion framework and its mathematical derivation of its probability decomposition. At the single robot level, the semantic point cloud is obtained by combining information from heterogeneous sensors and used to generate local semantic maps. At the collaborative robots level, local maps are shared among robots for global semantic map fusion. Since the voxel correspondence is unknown between local maps, an expectation-maximization approach is proposed to estimate the hidden data association. Then, Bayesian rule is applied to perform semantic and occupancy probability update. Experimental results on the unmanned aerial vehicle and the unmanned ground vehicle platforms show the high quality of global semantic maps, demonstrating the accuracy and utility in practical missions.
Keywords:
Semantics
Robot sensing systems
Collaboration
Geometry
Three-dimensional displays
Robot kinematics
Collaborative information fusion
mobile robots
semantic mapping
semantic segmentation
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
I
IF:
7.3
Papers:
5.4K
Citations:
2.4W

