.png){kind=icon}
返回
Formation Control With Collision Avoidance Through Deep Reinforcement Learning Using Model-Guided Demonstration
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2020.3004893.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Generating collision-free, time-efficient paths in an uncertain dynamic environment poses huge challenges for the formation control with collision avoidance (FCCA) problem in a leader-follower structure. In particular, the followers have to take both formation maintenance and collision avoidance into account simultaneously. Unfortunately, most of the existing works are simple combinations of methods dealing with the two problems separately. In this article, a new method based on deep reinforcement learning (RL) is proposed to solve the problem of FCCA. Especially, the learning-based policy is extended to the field of formation control, which involves a two-stage training framework: an imitation learning (IL) and later an RL. In the IL stage, a model-guided method consisting of a consensus theory-based formation controller and an optimal reciprocal collision avoidance strategy is designed to speed up training and increase efficiency. In the RL stage, a compound reward function is presented to guide the training. In addition, we design a formation-oriented network structure to perceive the environment. Long short-term memory is adopted to enable the network structure to perceive the information of obstacles of an uncertain number, and a transfer training approach is adopted to improve the generalization of the network in different scenarios. Numerous representative simulations are conducted, and our method is further deployed to an experimental platform based on a multiomnidirectional-wheeled car system. The effectiveness and practicability of our proposed method are validated through both the simulation and experiment results.
Keyword:
Collision avoidance
Training
Maintenance engineering
Machine learning
Multi-agent systems
Task analysis
Collision avoidance
deep reinforcement learning (DRL)
formation control
leader-follower
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
Clinically applicable deep learning for diagnosis and referral in retinal disease深度学习在视网膜疾病诊断和转诊中的临床应用.png)
NATURE MEDICINE
NATURE MEDICINEIF50
PREAI
分享收藏Finite-time consensus and collision avoidance control algorithms for multiple AUVsAUTOMATICA
AUTOMATICAIF5.9
PREAI
分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏
查看更多内容