arrow
Return

Differential variable speed limits control for freeway recurrent bottlenecks via deep actor-critic algorithm

delete2020-08-01
delete73
PRE
AI
Y
Yuankai Wu
H
Huachun Tan *
L
Lingqiao Qin
B
Bin Ran
DOI:10.1016/j.trc.2020.102649delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Variable speed limit (VSL) control is a flexible way to improve traffic conditions, increase safety, and reduce emissions. There is an emerging trend of using reinforcement learning methods for VSL control. Currently, deep learning is enabling reinforcement learning to develop autonomous control agents for problems that were previously intractable. In this paper, a more effective deep reinforcement learning (DRL) model is developed for differential variable speed limit (DVSL) control, in which dynamic and distinct speed limits among lanes can be imposed. The proposed DRL model uses a novel actor-critic architecture to learn a large number of discrete speed limits in a continuous action space. Different reward signals, such as total travel time, bottleneck speed, emergency braking, and vehicular emissions are used to train the DVSL controller, and a comparison between these reward signals is conducted. The proposed DRL-based DVSL controllers are tested on a freeway with a simulated recurrent bottleneck. The simulation results show that the DRL based DVSL control strategy is able to improve the safety, efficiency and environmentfriendliness of the freeway. In order to verify whether the controller generalizes to real world implementation, we also evaluate the generalization of the controllers on environments with different driving behavior attributes. and the robustness of the DRL agent is observed from the results.
Keywords:
Variable speed limit
Deep reinforcement learning
Connected and autonomous vehicles
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Transportation Research Part C-Emerging Technologies cover
Transportation Research Part C-Emerging Technologies
IF:
7.9
Papers:
4.7K
Citations:
3.2W

Organization

University of Wisconsin System cover
University of Wisconsin System
Scholars:
6.7W
Papers: 5.8W
Citations: 382
S
southeast university - china
Scholars:
5.3W
Papers: 4.9W
Citations: 57
M
McGill University
Scholars:
5.5W
Papers: 4.9W
Citations: 7.0W
researcher View more organizations