arrow
返回

Formula-E race strategy development using distributed policy gradient reinforcement learning

delete2021-03-01
delete6
delete
OA
AI
X
Xuze Liu *
A
Abbas Fotouhi
D
Daniel J. Auger
DOI:10.1016/j.knosys.2021.106781delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Energy and thermal management is a crucial element in Formula-E race strategy development. In this study, the race-level strategy development is formulated into a Markov decision process (MDP) problem featuring a hybrid-type action space. Deep Deterministic Policy Gradient (DDPG) reinforcement learning is implemented under distributed architecture Ape-X and integrated with the prioritized experience replay and reward shaping techniques to optimize a hybrid-type set of actions of both continuous and discrete components. Soft boundary violation penalties in reward shaping, significantly improves the performance of DDPG and makes it capable of generating faster race finishing solutions. The new proposed method has shown superior performance in comparison to the Monte Carlo Tree Search (MCTS) with policy gradient reinforcement learning, which solves this problem in a fully discrete action space as presented in the literature. The advantages are faster race finishing time and better handling of ambient temperature rise. (C) 2021 Elsevier B.V. All rights reserved.
Keyword:
Energy management
Formula-E race strategy
Deep deterministic policy gradient
Reinforcement leaning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

K
Knowledge-Based Systems
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

C
cranfield university
学者数:
6.3K
论文数: 6.6K
被引数: 1
引用论文

引用论文

err分享
err收藏
Major Depression and Disability in Older Primary Care Patients With Heart Failure
err2008-06-01
err0
PREAI
errBruce Friedman; Jeffrey M. Lyness; Rachel L. Delavan; Chunyu Li; William H. Barker
err分享
err收藏
err分享
err收藏
Optimal control for a Formula One car with variable parameters
err2014-02-27
err115
errOAAI
errPerantoni, Giacomo; Limebeer, David J. N.
err分享
err收藏
Trip-oriented stochastic optimal energy management strategy for plug-in hybrid electric bus
errENERGY
IF9.4
err2016-11-01
err68
PREAI
errDu, Yongchang; Zhao, Yue; Wang, Qinpu; Zhang, Yuanbo; Xia, Huaicheng
err分享
err收藏
Surface modified electrospun porous magnetic hollow fibers using secondary downstream collection solvent contouring
err2017-10-01
err0
errOAAI
errShuting Wu; Baolin Wang; Zeeshan Ahmad; Jie Huang; Ming-Wei Chang; Jing-Song Li
err分享
err收藏
Energy Management of Parallel-Connected Cells in Electric Vehicles Based on Fuzzy Logic Control
err2017-03-21
err19
errOAAI
errSong, Chuanxue; Shao, Yulong; Song, Shixin; Chang, Cheng; Zhou, Fang; Peng, Silun; Xiao, Feng
err分享
err收藏
学者 查看更多内容