arrow
Return

Multi-Robot Collaborative Complex Indoor Scene Segmentation via Multiplex Interactive Learning

delete2025-11-01
delete0
delete
OA
AI
J
Jinfu Liu
J
Jiang, Zhongzien
X
Xinhua Xu
W
Wenhao Li
M
Meng‐Yuan Liu
刘泓 cover
刘泓 (Hong Liu) *
DOI:10.1049/cit2.70066delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Indoor scene semantic segmentation is essential for enabling robots to understand and interact with their environments effectively. However, numerous challenges remain unresolved, particularly in single-robot systems, which often struggle with the complexity and variability of indoor scenes. To address these limitations, we introduce a novel multi-robot collaborative framework based on multiplex interactive learning (MPIL) in which each robot specialises in a distinct visual task within a unified multitask architecture. During training, the framework employs task-specific decoders and cross-task feature sharing to enhance collaborative optimisation. At inference time, robots operate independently with optimised models, enabling scalable, asynchronous and efficient deployment in real-world scenarios. Specifically, MPIL employs specially designed modules that integrate RGB and depth data, refine feature representations and facilitate the simultaneous execution of multiple tasks, such as instance segmentation, scene classification and semantic segmentation. By leveraging these modules, distinct agents within multi-robot systems can effectively handle specialised tasks, thereby enhancing the overall system's flexibility and adaptability. This collaborative effort maximises the strengths of each robot, resulting in a more comprehensive understanding of environments. Extensive experiments on two public benchmark datasets demonstrate MPIL's competitive performance compared to state-of-the-art approaches, highlighting the effectiveness and robustness of our multi-robot system in complex indoor environments.
Keywords:
cross-task interactive
learning (artificial intelligence)
multi-modal
multiplex interactive learning
multitask
object segmentation
semantic segmentation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

CAAI Transactions on Intelligence Technology cover
CAAI Transactions on Intelligence Technology
IF:
7.3
Papers:
649
Citations:
2.4K

Organization

P
Peking University
Scholars:
1.0W
Papers: 3.8K
Citations: 14.7W