arrow
返回

Imagination-Augmented Reinforcement Learning Framework for Variable Speed Limit Control

delete2024-02-01
delete2
delete
OA
AI
D
Duo Li *
J
Joan Lasenby
DOI:10.1109/TITS.2023.3316285delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Variable Speed Limit (VSL) is a commonly applied active traffic management measure for urban motorways. In recent years, model-based and model-free approaches have been extensively adopted to solve VSL optimization problems. However, the success of model-based VSL relies heavily on the nature of the environmental model adopted (e.g., traffic flow model). Implicit environment models may result in inappropriate control actions. Although model-free approaches are able to directly map raw measurements to control actions without a need for an environment model, they usually require large amounts of training data. In order to address these issues, we propose an Imagination-Augmented Agent (I2A) for VSL control. The I2A consists an imagination path and a model-free path, which work together to generate appropriate control actions. The simulation results show that the proposed I2A agent outperforms other tested Reinforcement Learning (RL) agents in terms of Total Time Spent and bottleneck volume.
Keyword:
Q-learning
Mathematical models
Optimization
Heuristic algorithms
Computational modeling
Aerospace electronics
Detectors
Motorway control
variable speed limit
deep reinforcement learning

期刊

IEEE Transactions on Intelligent Transportation Systems 封面图
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
论文数:
9.7K
被引数:
6.3W

机构

U
University of Cambridge
学者数:
7.7W
论文数: 7.1W
被引数: 13.7W
引用论文

引用论文

Digital holography microscopy in 3D biologic samples analysis
err2011-02-25
err0
errOAAI
errJ O Ricardo; M Muramatsu; F Palacios; M Gesualdi; O Font; J L Valin; M Escobedo; S Herold; D F Palacios; G F Palacios; A Sánchez
err分享
err收藏
Nanoscale-Thick Thin Films of High-Density HfO2 for Bulk-like Optical Responses
err2021-09-30
err0
PREAI
errLirong Sun; John G. Jones; John T. Grant; Neil R. Murphy; C. V. Ramana; Kurt G. Eyink; Jonathan P. Vernon; Peter R. Stevenson
err分享
err收藏
Reactions of Dianionic α-Diimine-Supported Dimagnesium(I) Compound [K(THF)3]2[LMg–MgL] with Nitriles
err2019-06-26
err0
PREAI
errJijiang Wang; Juju Wang; Lingyi Shen; Yanxia Zhao; Biao Wu; Xiao-Juan Yang
err分享
err收藏
Effect of Additives on the Performance of the Fire-Clay Refractory Bricks
err2010-01-11
err0
errOAAI
errMarwa A.G. Elngar; Mohamed F.M.; Asrar G.; Carmen M. Sharaby; Shalabi M.E.H.
err分享
err收藏
Cementitious Porous Material Applied to Precision Aerostatics Bearings
err2018-02-11
err0
PREAI
errLeandro Jos da Silva; Tulio Hallak Panzera; Luciano Machado Gomes Viera; Christopher Rhys Bowen; Jaime Gilberto Duduch; Juan Carlos Campos Rubio
err分享
err收藏
学者 查看更多内容