.png){kind=icon}
返回
Applications in Traffic Signal Control: A Distributed Policy Gradient Decomposition Algorithm
.png){kind=icon}
PRE
AI
DOI：10.1109/TII.2023.3296887.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article explores the application of the multiagent reinforcement learning (MARL) algorithm in addressing the large-scale traffic signal control (TSC) problem. To address the TSC problem in complex urban traffic networks, most existing algorithms focus on optimizing local traffic flow at each intersection through decentralized training based on either the local observations or messages from its neighboring intersections, which, however, lacks the concept of cooperative learning. To conquer such limitations, a novel distributed critic with decentralized actor (DCDA) framework is proposed, which allows the communication messages and temporal difference (TD) losses to be exchanged among neighboring intersections. Specially, by considering the traffic network as a communication network of agents (more precisely, intersections and lanes are considered as agents and edges, respectively), a distributed global average TD loss estimation algorithm is designed in the distributed critic step to estimate the global average TD loss estimation and enhance collaboration among agents. Moreover, in the decentralized actor step, the policy gradient decomposition method is adopted for each agents to learn its local policy solely based on its local action-value function. By adhering to the DCDA framework, a novel distributed policy gradient decomposition (DPGD) algorithm is further proposed to address the TSC problem. Empirical experiments demonstrate that the efficiency, robustness, and stability of the DPGD algorithm outperform the state-of-the-art MARL algorithms in both the environments of cooperative adaptive cruise control and adaptive traffic signal control.
Keyword:
Vehicle dynamics
Estimation
Roads
Informatics
Electronic mail
Training
Scalability
Distributed critic with decentralized actor (DCDA)
distributed policy gradient decomposition (DPGD)
multiagent reinforcement learning (MARL)
traffic signal control (TSC)
期刊
IF:
9.9
论文数:
8.6K
被引数:
6.0W
机构
引用论文
Defect-related photoluminescence properties of as-synthesized and annealed NiO nanostructures via hydrothermal method通过水热法合成和退火的NiO纳米结构的缺陷相关的光致发光特性
.png){kind=icon}
PREAI
分享收藏Sustainability at stake during COVID-19: Exploring the role of accounting in addressing environmental crises新型冠状病毒肺炎期间的可持续性: 探索会计在应对环境危机中的作用
PREAI
分享收藏
分享收藏
查看更多内容