arrow
Return

Temporal Difference-Aware Graph Convolutional Reinforcement Learning for Multi-Intersection Traffic Signal Control

delete2024-01-01
delete4
PRE
AI
W
Wei‐Yu Lin
Y
Yun-Zhu Song
B
Bo-Kai Ruan
H
Hong-Han Shuai *
C
Chih-Ya Shen
王立春 (Li‐Chun Wang)
Y
Yung‐Hui Li
DOI:10.1109/TITS.2023.3311426delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Traffic light control plays a crucial role in intelligent transportation systems. This paper introduces Temporal Difference-Aware Graph Convolutional Reinforcement Learning (TeDA-GCRL), a decentralized RL-based method for efficient multi-intersection traffic signal control. Specifically, we put forward a new graph architecture using each lane as a node for considering intersection relations. Additionally, we propose two new rewards by considering temporal information, namely Temporal-Aware Pressure on Incoming Lanes (TAPIL) and Temporal-Aware Action Consistency (TAAC), which enhance learning efficiency and time-interval sensitivity. Experimental results on five datasets show the superiority of TeDA-GCRL over state-of-the-art methods by at least 9.5% in average travel time.
Keywords:
Traffic light control
neural networks
graph neural network
reinforcement learning

Journal

IEEE Transactions on Intelligent Transportation Systems cover
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
Papers:
9.5K
Citations:
6.3W

Organization

N
National Tsing Hua University
Scholars:
1.6W
Papers: 1.4W
Citations: 1.7W
N
National Yang Ming Chiao Tung University
Scholars:
2.5W
Papers: 2.3W
Citations: 2.2W
Cited Papers

Cited Papers

err
IF0
err
err0
PREAI
err
errShare
errSave
On Distributed Implementation of Switch-Based Adaptive Dynamic Programming
err2022-07-01
err19
errOAAI
errLiu, Di; Baldi, Simone; Yu, Wenwu; Chen, Guanrong
errShare
errSave
Distributed Services Attestation in IoT
err2018-11-30
err0
PREAI
errMauro Conti; Edlira Dushku; Luigi V. Mancini
errShare
errSave
Nonlocal energetic particle mode in a JT-60U plasma
err2004-12-03
err0
errOAAI
errY. Todo; K. Shinohara; M. Takechi; M. Ishikawa
errShare
errSave
Using Reinforcement Learning With Partial Vehicle Detection for Intelligent Traffic Signal Control
err2021-01-01
err88
errOAAI
errZhang, Rusheng; Ishikawa, Akihiro; Wang, Wenli; Striner, Benjamin; Tonguz, Ozan K.
errShare
errSave
researcher View more