arrow
Return

Imagination-Augmented Reinforcement Learning Framework for Variable Speed Limit Control

delete2024-02-01
delete2
delete
OA
AI
D
Duo Li *
J
Joan Lasenby
DOI:10.1109/TITS.2023.3316285delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Variable Speed Limit (VSL) is a commonly applied active traffic management measure for urban motorways. In recent years, model-based and model-free approaches have been extensively adopted to solve VSL optimization problems. However, the success of model-based VSL relies heavily on the nature of the environmental model adopted (e.g., traffic flow model). Implicit environment models may result in inappropriate control actions. Although model-free approaches are able to directly map raw measurements to control actions without a need for an environment model, they usually require large amounts of training data. In order to address these issues, we propose an Imagination-Augmented Agent (I2A) for VSL control. The I2A consists an imagination path and a model-free path, which work together to generate appropriate control actions. The simulation results show that the proposed I2A agent outperforms other tested Reinforcement Learning (RL) agents in terms of Total Time Spent and bottleneck volume.
Keywords:
Q-learning
Mathematical models
Optimization
Heuristic algorithms
Computational modeling
Aerospace electronics
Detectors
Motorway control
variable speed limit
deep reinforcement learning

Journal

IEEE Transactions on Intelligent Transportation Systems cover
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
Papers:
9.7K
Citations:
6.3W

Organization

U
University of Cambridge
Scholars:
7.7W
Papers: 7.1W
Citations: 13.7W
Cited Papers

Cited Papers

Digital holography microscopy in 3D biologic samples analysis
err2011-02-25
err0
errOAAI
errJ O Ricardo; M Muramatsu; F Palacios; M Gesualdi; O Font; J L Valin; M Escobedo; S Herold; D F Palacios; G F Palacios; A Sánchez
errShare
errSave
Nanoscale-Thick Thin Films of High-Density HfO2 for Bulk-like Optical Responses
err2021-09-30
err0
PREAI
errLirong Sun; John G. Jones; John T. Grant; Neil R. Murphy; C. V. Ramana; Kurt G. Eyink; Jonathan P. Vernon; Peter R. Stevenson
errShare
errSave
Reactions of Dianionic α-Diimine-Supported Dimagnesium(I) Compound [K(THF)3]2[LMg–MgL] with Nitriles
err2019-06-26
err0
PREAI
errJijiang Wang; Juju Wang; Lingyi Shen; Yanxia Zhao; Biao Wu; Xiao-Juan Yang
errShare
errSave
Effect of Additives on the Performance of the Fire-Clay Refractory Bricks
err2010-01-11
err0
errOAAI
errMarwa A.G. Elngar; Mohamed F.M.; Asrar G.; Carmen M. Sharaby; Shalabi M.E.H.
errShare
errSave
Cementitious Porous Material Applied to Precision Aerostatics Bearings
err2018-02-11
err0
PREAI
errLeandro Jos da Silva; Tulio Hallak Panzera; Luciano Machado Gomes Viera; Christopher Rhys Bowen; Jaime Gilberto Duduch; Juan Carlos Campos Rubio
errShare
errSave
researcher View more