arrow
返回

A deep reinforcement learning-based active suspension control algorithm considering deterministic experience tracing for autonomous vehicle

delete2024-03-01
delete7
PRE
AI
王珵 封面图
王珵 (Cheng Wang)
X
Xiaoxian Cui
S
Shijie Zhao *
X
Xinran Zhou
Y
Yang Wang
郭
郭孔辉 (Konghui Guo)
DOI:10.1016/j.asoc.2024.111259delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
As the challenges in autonomous driving become more complex and changing, traditional methods are struggling to cope. As a result, artificial intelligence (AI) techniques have gained widespread attention due to their potential in addressing these challenges. To investigate the application and performance of deep reinforcement learning (DRL) techniques in vertical control of autonomous vehicles, we propose an active suspension control algorithm that incorporates deterministic experience tracing (DET). The agent explores and learns deterministic policies by interacting with the environment and continuously exploring and exploiting the generated data. During this process, DET stores state and action data in a separate experience memory buffer over time. Additionally, DET processes this information into auxiliary rewards that decay based on temporal logic. This drives the agent to self-iterate and rapidly improve. DET allows AI techniques to incorporate temporal robustness into data-driven learning, resulting in improved generalization performance and optimized ride comfort in engineering applications. Simulation results demonstrated that DET improved control performance by 74.92%, 64.20%, and 54.64% compared to the deep deterministic policy gradient (DDPG), twin delayed deep deterministic policy gradient (TD3), and model predictive control (MPC) baselines, respectively. Furthermore, it achieved nearly a 90% improvement in ride comfort on random roads in classes A, B, and C across different speeds. Even on class D roads, the optimization remained around 85%, demonstrating its excellent generalization performance.
Keyword:
Deep reinforcement learning
Active suspension system
Data-driven
Deterministic experience tracing
Ride comfort

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

J
Jilin University
学者数:
8.7W
论文数: 5.6W
被引数: 8.9K
引用论文

引用论文

err分享
err收藏
Eutectic behaviour of binary mixtures composed of two isomeric lactic acid derivatives
err2016-03-16
err0
PREAI
errAlexej Bubnov; Natalia Podoliak; Věra Hamplová; Petra Tomášková; Jaroslav Havlíček; Miroslav Kašpar
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容