arrow
返回

Transformer-Based Imitative Reinforcement Learning for Multirobot Path Planning

delete2023-10-01
delete21
PRE
AI
L
Lin Chen
王耀南 封面图
王耀南 (Yaonan Wang)
Z
Zhiqiang Miao *
Y
Yang Mo
M
Mingtao Feng
Z
Zhen Zhou
H
Hesheng Wang
DOI:10.1109/TII.2023.3240585delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multirobot path planning leads multiple robots from start positions to designated goal positions by generating efficient and collision-free paths. Multirobot systems realize coordination solutions and decentralized path planning, which is essential for large-scale systems. The state-of-the-art decentralized methods utilize imitation learning and reinforcement learning methods to teach fully decentralized policies, dramatically improving their performance. However, these methods cannot enable robots to perform tasks efficiently in relatively dense environments without communication between robots. We introduce the transformer structure into policy neural networks for the first time, dramatically enhancing the ability of policy neural networks to extract features that facilitate collaboration between robots. It mainly focuses on improving the performance of policies in relatively dense multirobot environments under conditions where robots do not communicate with each other. Furthermore, a novel imitation reinforcement learning framework is proposed by combining contrastive learning and double deep Q-network to solve the problem of difficulty training policy neural networks after introducing the transformer structure. We present results in the simulation environment and compare the resulting policy against advanced multirobot path-planning methods in terms of success rate. Simulation results show that our policy achieves state-of-the-art performance when there is no communication between robots. Finally, we experimented with a real-world case using a total of three robots in our robotic laboratory.
Keyword:
Feature extraction
imitation learning
multirobot path planning (MRPP)
reinforcement learning
robot learning
supervision contrastive learning

期刊

IEEE Transactions on Industrial Informatics 封面图
IEEE Transactions on Industrial Informatics
IF:
9.9
论文数:
8.6K
被引数:
6.0W

机构

S
shanghai jiao tong university
学者数:
15.7W
论文数: 11.7W
被引数: 159
H
hunan university
学者数:
4.5W
论文数: 3.3W
被引数: 70
X
Xidian University
学者数:
2.4W
论文数: 1.9W
被引数: 9.7K
学者 查看更多机构
引用论文

引用论文

The increasing cost tree search for optimal multi-agent pathfinding
err2013-02-01
err202
errOAAI
errSharon, Guni; Stern, Roni; Goldenberg, Meir; Felner, Ariel
err分享
err收藏
Evolution of the COPD Assessment Test Score during Chronic Obstructive Pulmonary Disease Exacerbations: Determinants and Prognostic Value
err2013-01-01
err0
errOAAI
errDarwin Feliz-Rodriguez; Santiago Zudaire; Carlos Carpio; Elizabet Martínez; Antonia Gómez-Mendieta; Ana Santiago; Rodolfo Alvarez-Sala; Francisco García-Río
err分享
err收藏
Dynamical analysis of relaxation luminescence in ZnS:Er3+ thin film devices
err2003-06-15
err0
PREAI
errYu-Jiang Wang; Chen-Xu Wu; Mou-Zhi Chen; Mei-Chun Huang
err分享
err收藏
Mo(Co)6Induced Cleavage of Oximes
err2006-08-22
err0
PREAI
errFlorence Geneste; Nadia Racelma; Alec Moradpour
err分享
err收藏
学者 查看更多内容