arrow
Return

Deep reinforcement learning enabled self-learning control for energy efficient driving

delete2019-02-01
delete173
PRE
AI
X
Xuewei Qi *
Y
Yadan Luo
G
Guoyuan Wu
K
Kanok Boriboonsomsin
M
Matthew Barth
DOI:10.1016/j.trc.2018.12.018delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
To address the air pollution problems and reduce greenhouse gas emissions (GHG), plug-in hybrid electric vehicles (PHEV) have been developed to achieve higher fuel efficiency. The Energy Management System (EMS) is a very important component of a PHEV in achieving better fuel economy and it is a very active research area. So far, most of the existing EMS strategies are either just simply following predefined rules that are not adaptive to changing driving conditions; or heavily relying on accurate prediction of future traffic conditions. Deep learning algorithms have been successfully applied to many complex problems and proved to even outperform human beings in some tasks (e.g., play chess) in recent years, which shows the great potential of such methods in practical engineering problems. In this study, a deep reinforcement learning (Deep Q-network or DQN) based PHEV energy management system is designed to autonomously learn the optimal fuel/electricity splits from interactions between the vehicle and the traffic environment. It is a fully data-driven and self-learning model that does not rely on any prediction, predefined rules or even prior human knowledge. The experiment results show that the proposed model is capable of achieving 16.3% energy savings (with the designed PHEV simulation model) on a typical commute trip, compared to conventional binary control strategies. In addition, a dueling Deep Q-network with dueling structure (DDQN) is also implemented and compared with single DQN in particular with respect to the convergence rate in the training process.
Keywords:
Deep reinforcement learning
PHEV
Energy efficiency
Self-learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Transportation Research Part C-Emerging Technologies cover
Transportation Research Part C-Emerging Technologies
IF:
7.9
Papers:
4.7K
Citations:
3.2W

Organization

U
university of california riverside
Scholars:
1.1W
Papers: 8.3K
Citations: 16
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K