arrow
Return

Deep deterministic policy gradient algorithm for crowd-evacuation path planning

delete2021-11-01
delete18
PRE
AI
李
李新进 (Xinjin Li)
H
Hong Liu *
J
Junqing Li
Y
Yan Li
DOI:10.1016/j.cie.2021.107621delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In existing evacuation methods, the large number of pedestrians and the complex environment will affect the efficiency of evacuation. Therefore, we propose a hierarchical evacuation method based on multi-agent deep reinforcement learning (MADRL) to solve the above problem. First, we use a two-level evacuation mechanism to guide evacuations, the crowd is divided into leaders and followers. Second, in the upper level, leaders perform path planning to guide the evacuation. To obtain the best evacuation path, we propose the efficient multi-agent deep deterministic policy gradient (E-MADDPG) algorithm for crowd-evacuation path planning. E-MADDPG algorithm combines learning curves to improve the fixed experience pool of MADDPG algorithm and uses high priority experience playback strategy to improve the sampling strategy. The improvement increases the learning efficiency of the algorithm. Meanwhile we extract pedestrian motion trajectories from real motion videos to reduce the state space of algorithm. Third, in the bottom layer, followers use the relative velocity obstacle (RVO) algorithm to avoid collisions and follow leaders to evacuate. Finally, experimental results illustrate that the EMADDPG algorithm can improve path planning efficiency, while the proposed method can improve the efficiency of crowd evacuation.
Keywords:
Deep reinforcement learning
Multi-agent reinforcement learning
Path planning
Crowd simulation for evacuation

Journal

Computers and Industrial Engineering cover
Computers and Industrial Engineering
IF:
6.5
Papers:
1.0W
Citations:
3.8W

Organization

S
shandong normal university
Scholars:
1.0W
Papers: 8.2K
Citations: 3
Cited Papers

Cited Papers

Mini‐Mental State Examination
err2002-04-30
err0
PREAI
errJoseph R. Cockrell; Marshal F. Folstein
errShare
errSave
A social force evacuation model driven by video data
err2018-05-01
err92
PREAI
errLiu, Baoxi; Liu, Hong; Zhang, Hao; Qin, Xin
errShare
errSave
Knowledge and emotion dual-driven method for crowd evacuation
err2020-11-01
err35
PREAI
errTian, Zena; Zhang, Guijuan; Hu, Chunyu; Lu, Dianjie; Liu, Hong
errShare
errSave
Evacuation route recommendation using auto-encoder and Markov decision process
err2019-11-01
err28
PREAI
errBi, Chongke; Pan, Guosheng; Yang, Lu; Lin, Chun-Cheng; Hou, Min; Huang, Yuanqi
errShare
errSave
Discriminative deep belief networks for visual data classification
err2011-10-01
err89
PREAI
errLiu, Yan; Zhou, Shusen; Chen, Qingcai
errShare
errSave
A Hybrid Iterated Greedy Algorithm for a Crane Transportation Flexible Job Shop Problem
err2022-07-01
err105
PREAI
errLi, Jun-Qing; Du, Yu; Gao, Kai-Zhou; Duan, Pei-Yong; Gong, Dun-Wei; Pan, Quan-Ke; Suganthan, P. N.
errShare
errSave
researcher View more