arrow
Return

OpenMulti: Open-Vocabulary Instance-Level Multi-Agent Distributed Implicit Mapping

delete
delete0
PRE
AI
J
Jianyu Dou
Y
Yinan Deng
J
Jiahui Wang
X
Xingsi Tang
易扬 cover
易扬 (Yi Yang)
Y
Yufeng Yue
DOI:10.1109/LRA.2025.3597513delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multi-agent distributed collaborative mapping provides comprehensive and efficient representations for robots. However, existing approaches lack instance-level awareness and semantic understanding of environments, limiting their effectiveness for downstream applications. To address this issue, we propose OpenMulti, an open-vocabulary instance-level multi-agent distributed implicit mapping framework. Specifically, we introduce a Cross-Agent Instance Alignment module, which constructs an Instance Collaborative Graph to ensure consistent instance understanding across agents. To alleviate the degradation of mapping accuracy due to the blind-zone optimization trap, we leverage Cross Rendering Supervision to enhance distributed learning of the scene. Experimental results show that OpenMulti outperforms related algorithms in both fine-grained geometric accuracy and zero-shot semantic accuracy. In addition, OpenMulti supports instance-level retrieval tasks, delivering semantic annotations for downstream applications.
Keywords:
Multi-agent
implicit mapping
open-vocabulary
instance-level

Journal

I
IEEE Robotics and Automation Letters
IF:
5.3
Papers:
2.0K
Citations:
3.9W

Organization

B
beijing institute of technology
Scholars:
5.5W
Papers: 4.0W
Citations: 63
Cited Papers

Cited Papers

High Quality Entity Segmentation
err2023-10-01
err0
errOAAI
errLu Qi; Jason Kuen; Tiancheng Shen; Jiuxiang Gu; Wenbo Li; Weidong Guo; Jiaya Jia; Zhe Lin; Ming-Hsuan Yang
errShare
errSave
MACIM: Multi-Agent Collaborative Implicit Mapping
err2024-05-01
err0
PREAI
errDeng,Yinan; Tang,Yujie; Yang,Yi; Wang,Danwei; Yue,Yufeng
errShare
errSave
errShare
errSave
LERF: Language Embedded Radiance Fields
err2023-10-01
err0
errOAAI
errJustin Kerr; Chung Min Kim; Ken Goldberg; Angjoo Kanazawa; Matthew Tancik
errShare
errSave
ConceptFusion: Open-set multimodal 3D mapping
err2023-07-10
err0
errOAAI
errKrishna Jatavallabhula; Alihusein Kuwajerwala; Qiao Gu; Mohd Omama; Ganesh Iyer; Soroush Saryazdi; Tao Chen; Alaa Maalouf; Shuang Li; Nikhil Keetha; Ayush Tewari; Joshua Tenenbaum; Celso Melo; Madhava Krishna; Liam Paull; Florian Shkurti; Antonio Torralba
errShare
errSave
OpenScene: 3D Scene Understanding with Open Vocabularies
err2023-06-01
err0
errOAAI
errSongyou Peng; Kyle Genova; Chiyu Jiang; Andrea Tagliasacchi; Marc Pollefeys; Thomas Funkhouser
errShare
errSave
researcher View more