.png){kind=icon}
返回
A large-scale traffic signal control algorithm based on multi-layer graph deep reinforcement learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.trc.2024.104582.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Due to its capability in handling complex urban intersection environments, deep reinforcement learning (DRL) has been widely applied in Adaptive Traffic Signal Control (ATSC). However, most existing algorithms are designed for specific road networks or traffic conditions, making it difficult to transfer them to new environments. Moreover, current graph-based algorithms do not fully capture the geometric and spatial features of intersections, leading to incomplete embedding of the agent's environment depiction. Additionally, the actions adopted by these algorithms are inherently based on fixed-cycle phases, limiting the flexibility of traffic signal control. To address the aforementioned issues, this paper proposes a Multi-layer Graph Mask Q-Learning (MGMQ) algorithm for multi-intersection ATSC to optimize traffic and reduce delay. Unlike previous graph-based algorithms, this paper introduces a method for computing multi-layer graphs, dividing the traffic environment into upper-level traffic network-layer graphs and lower-level intersection-layer graphs, and employs the graph attention algorithm and an improved GraphSAGE algorithm for computation. This method not only enables the generation of embedded state for intersections that include geometric and spatial features, but also allows the algorithm to adapt to different traffic conditions and road networks. Additionally, we introduce an action masking mechanism, allowing this algorithm can be adapted to different action spaces. As a result, the algorithm uses arbitrary signal phases as actions to achieve flexible traffic flow control, and can be directly applied to intersections with arbitrary geometry. The final test results demonstrate that a model trained solely on synthetic road networks can be directly transferred to other synthetic network configurations or real-world urban road networks, outperforming current state-of-the-art algorithms.
Keyword:
Deep reinforcement learning
Adaptive traffic signal control
Multi-layer graph structure
Mask-action
Zero-training transfer
期刊
IF:
7.9
论文数:
4.9K
被引数:
3.2W
机构
引用论文
An inductive heterogeneous graph attention-based multi-agent deep graph infomax algorithm for adaptive traffic signal control.png)
INFORMATION FUSION
INFORMATION FUSIONIF15.5
PREAI
分享收藏IHG-MA: Inductive heterogeneous graph multi-agent reinforcement learning for multi-intersection traffic signal controlIhg-ma: 用于多路口交通信号控制的归纳异构图多智能体强化学习NEURAL NETWORKS
NEURAL NETWORKSIF6.3
PREAI
分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏Adaptive Traffic Signal Control for large-scale scenario with Cooperative Group-based Multi-agent reinforcement learning基于协作组的多agent强化学习的大规模场景自适应交通信号控制
PREAI
分享收藏分享收藏
查看更多内容