arrow
返回

Deep deterministic policy gradient algorithm for crowd-evacuation path planning

delete2021-11-01
delete18
PRE
AI
李
李新进 (Xinjin Li)
H
Hong Liu *
J
Junqing Li
Y
Yan Li
DOI:10.1016/j.cie.2021.107621delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In existing evacuation methods, the large number of pedestrians and the complex environment will affect the efficiency of evacuation. Therefore, we propose a hierarchical evacuation method based on multi-agent deep reinforcement learning (MADRL) to solve the above problem. First, we use a two-level evacuation mechanism to guide evacuations, the crowd is divided into leaders and followers. Second, in the upper level, leaders perform path planning to guide the evacuation. To obtain the best evacuation path, we propose the efficient multi-agent deep deterministic policy gradient (E-MADDPG) algorithm for crowd-evacuation path planning. E-MADDPG algorithm combines learning curves to improve the fixed experience pool of MADDPG algorithm and uses high priority experience playback strategy to improve the sampling strategy. The improvement increases the learning efficiency of the algorithm. Meanwhile we extract pedestrian motion trajectories from real motion videos to reduce the state space of algorithm. Third, in the bottom layer, followers use the relative velocity obstacle (RVO) algorithm to avoid collisions and follow leaders to evacuate. Finally, experimental results illustrate that the EMADDPG algorithm can improve path planning efficiency, while the proposed method can improve the efficiency of crowd evacuation.
Keyword:
Deep reinforcement learning
Multi-agent reinforcement learning
Path planning
Crowd simulation for evacuation

期刊

Computers and Industrial Engineering 封面图
Computers and Industrial Engineering
IF:
6.5
论文数:
1.0W
被引数:
3.8W

机构

S
shandong normal university
学者数:
1.0W
论文数: 8.2K
被引数: 3
引用论文

引用论文

Mini‐Mental State Examination
err2002-04-30
err0
PREAI
errJoseph R. Cockrell; Marshal F. Folstein
err分享
err收藏
err分享
err收藏
Evacuation route recommendation using auto-encoder and Markov decision process
err2019-11-01
err28
PREAI
errBi, Chongke; Pan, Guosheng; Yang, Lu; Lin, Chun-Cheng; Hou, Min; Huang, Yuanqi
err分享
err收藏
Discriminative deep belief networks for visual data classification
err2011-10-01
err89
PREAI
errLiu, Yan; Zhou, Shusen; Chen, Qingcai
err分享
err收藏
A Hybrid Iterated Greedy Algorithm for a Crane Transportation Flexible Job Shop Problem
err2022-07-01
err105
PREAI
errLi, Jun-Qing; Du, Yu; Gao, Kai-Zhou; Duan, Pei-Yong; Gong, Dun-Wei; Pan, Quan-Ke; Suganthan, P. N.
err分享
err收藏
学者 查看更多内容