arrow
返回

Auto-learning communication reinforcement learning for multi-intersection traffic light control

delete2023-09-01
delete9
PRE
AI
Z
Zhu, Ruijie
S
Shuning Wu
李
李璐璐 (Lulu Li)
徐明亮 封面图
徐明亮 (Mingliang Xu) *
DOI:10.1016/j.knosys.2023.110696delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-agent reinforcement learning is a promising solution to achieve intelligent traffic light control by regarding each intersection as an independent agent. However, agents encounter partial observability and environmental instability issues when learning optimal strategies. To mitigate the impacts caused by the partial observability of cooperative agents, we propose the auto-learning communication reinforcement learning (ALCORL) method based on the advantage actor-critic algorithm. ALCORL enables intersections to communicate and enhance cooperation by receiving messages from adjacent intersections in multi-intersection scenarios. Specifically, the autoencoder is introduced into ALCORL to dynamically learn communication messages instead of defining specific communication regulations. Different from most studies that control the sequential conversion of phases to improve traffic conditions, we focus on regulating the phase duration directly and scheduling the traffic light time more flexibly. We conduct extensive experiments on different-scale datasets and ever-changing traffic conditions to verify the validity of ALCORL. The experimental results show that ALCORL performs better than several state-of-the-art algorithms in all evaluation metrics. & COPY; 2023 Elsevier B.V. All rights reserved.
Keyword:
Intelligent traffic light control
Multi-agent reinforcement learning
Multi-intersection
Autoencoder
Advantage actor-critic

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

Z
Zhengzhou University
学者数:
6.8W
论文数: 4.4W
被引数: 8.5W
引用论文

引用论文

ET-HF: A novel information sharing model to improve multi-agent cooperation
err2022-12-01
err9
PREAI
errXie, Shaorong; Zhang, Han; Yu, Hang; Li, Yang; Zhang, Zhenyu; Luo, Xiangfeng
err分享
err收藏
err分享
err收藏
学者 查看更多内容