arrow
Return

Auto-learning communication reinforcement learning for multi-intersection traffic light control

delete2023-09-01
delete9
PRE
AI
Z
Zhu, Ruijie
S
Shuning Wu
李
李璐璐 (Lulu Li)
徐明亮 cover
徐明亮 (Mingliang Xu) *
DOI:10.1016/j.knosys.2023.110696delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multi-agent reinforcement learning is a promising solution to achieve intelligent traffic light control by regarding each intersection as an independent agent. However, agents encounter partial observability and environmental instability issues when learning optimal strategies. To mitigate the impacts caused by the partial observability of cooperative agents, we propose the auto-learning communication reinforcement learning (ALCORL) method based on the advantage actor-critic algorithm. ALCORL enables intersections to communicate and enhance cooperation by receiving messages from adjacent intersections in multi-intersection scenarios. Specifically, the autoencoder is introduced into ALCORL to dynamically learn communication messages instead of defining specific communication regulations. Different from most studies that control the sequential conversion of phases to improve traffic conditions, we focus on regulating the phase duration directly and scheduling the traffic light time more flexibly. We conduct extensive experiments on different-scale datasets and ever-changing traffic conditions to verify the validity of ALCORL. The experimental results show that ALCORL performs better than several state-of-the-art algorithms in all evaluation metrics. & COPY; 2023 Elsevier B.V. All rights reserved.
Keywords:
Intelligent traffic light control
Multi-agent reinforcement learning
Multi-intersection
Autoencoder
Advantage actor-critic

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

Z
Zhengzhou University
Scholars:
6.8W
Papers: 4.4W
Citations: 8.5W
Cited Papers

Cited Papers

errShare
errSave
ET-HF: A novel information sharing model to improve multi-agent cooperation
err2022-12-01
err9
PREAI
errXie, Shaorong; Zhang, Han; Yu, Hang; Li, Yang; Zhang, Zhenyu; Luo, Xiangfeng
errShare
errSave
errShare
errSave
DRL-Based Deadline-Driven Advance Reservation Allocation in EONs for Cloud-Edge Computing
err2022-11-01
err12
PREAI
errZhu, Ruijie; Li, Gong; Wang, Peisen; Xu, Mingliang; Yu, Shui
errShare
errSave
Intelligent vehicle pedestrian light (IVPL): A deep reinforcement learning approach for traffic signal control
err2023-04-01
err24
PREAI
errYazdani, Mobin; Sarvi, Majid; Bagloee, Saeed Asadi; Nassir, Neema; Price, Jeff; Parineh, Hossein
errShare
errSave
errShare
errSave
researcher View more