arrow
Return

An intelligent full-knowledge transferable collaborative eco-driving framework based on improved soft actor-critic algorithm

delete2024-12-01
delete3
PRE
AI
R
Ruchen Huang
H
Hongwen He *
Q
Qicong Su
DOI:10.1016/j.apenergy.2024.124078delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Eco-driving is a promising technology for fuel cell vehicles (FCVs) that simultaneously achieves safe driving and energy saving in the urban transport sector, particularly through the application of cutting-edge deep reinforcement learning (DRL). However, developing specific DRL-based eco-driving strategies for different FCVs is a laborious task, since repetitive training is required when encountering various FCV types. To tackle this challenge, this paper proposes an intelligent transferable collaborative eco-driving framework across FCV types. Firstly, the eco-driving problem in the vehicle-following scenario is formulated by collaboratively integrating adaptive cruise control (ACC) with energy management strategy (EMS), and then an improved soft actor-critic (ISAC) algorithm is designed to solve this problem. After that, a source eco-driving strategy based on I-SAC is pretrained for a light fuel cell hybrid electric vehicle (FCHEV). Finally, all learned knowledge in the source strategy is fully transferred and reused for a heavy-duty fuel cell hybrid electric bus (FCHEB) to get the target eco-driving strategy. Experimental simulations show that the proposed framework can expedite the development of the ecodriving strategy for FCHEB by 94.83% while reducing hydrogen consumption by 10.05%.
Keywords:
Fuel cell vehicle (FCV)
Eco-driving strategy
Deep reinforcement learning (DRL)
Full-knowledge transfer
Improved soft actor-critic (I-SAC)

Journal

Applied Energy cover
Applied Energy
IF:
11
Papers:
2.6W
Citations:
17.8W

Organization

B
beijing institute of technology
Scholars:
5.5W
Papers: 4.0W
Citations: 63
Cited Papers

Cited Papers

Prioritized Experience Replay based on Multi-armed Bandit
err2022-03-01
err10
PREAI
errLiu, Ximing; Zhu, Tianqing; Jiang, Cuiqing; Ye, Dayong; Zhao, Fuqing
errShare
errSave
Hierarchical speed planning and energy management for autonomous plug-in hybrid electric vehicle in vehicle-following environment
errENERGY
IF9.4
err2022-12-01
err32
PREAI
errLiu, Yonggang; Huang, Bin; Yang, Yang; Lei, Zhenzhen; Zhang, Yuanjian; Chen, Zheng
errShare
errSave
errShare
errSave
Automated eco-driving in urban scenarios using deep reinforcement learning
err2021-05-01
err74
PREAI
errWegener, Marius; Koch, Lucas; Eisenbarth, Markus; Andert, Jakob
errShare
errSave
A comparative study of deep reinforcement learning based energy management strategy for hybrid electric vehicle
err2023-10-01
err17
PREAI
errWang, Zexing; He, Hongwen; Peng, Jiankun; Chen, Weiqi; Wu, Changcheng; Fan, Yi; Zhou, Jiaxuan
errShare
errSave
researcher View more