.png){kind=icon}
返回
Event-Triggered Deep Reinforcement Learning Using Parallel Control: A Case Study in Autonomous Driving
.png){kind=icon}
PRE
AI
DOI：10.1109/TIV.2023.3262132.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This paper utilizes parallel control to investigate the problem of event-triggered deep reinforcement learning and develops an event-triggered deep Q-network (ETDQN) for decision-making of autonomous driving, without training an explicit triggering condition. Based on the framework of parallel control, the developed ETDQN incorporates information of actions into the feedback and constructs a dynamic control policy. First, in the realization of the dynamic control policy, we integrate the current state and the previous action to construct the augmented state as well as the augmented Markov decision process. Meanwhile, it is shown theoretically that the goal of the developed dynamic control policy is to learn the variation rate of the action. The augmented state contains information of the current state and the previous action, which enables the developed ETDQN to directly design the immediate reward considering communication loss. Then, based on dueling double deep Q-network (dueling DDQN), we establish the augmented action-value, value, and advantage functions to directly learn the optimal event-triggered decision-making policy of autonomous driving without an explicit triggering condition. It is worth noticing that the developed ETDQN applies to various deep Q-networks (DQNs). Empirical results demonstrate that, in event-triggered control, the developed ETDQN outperforms dueling DDQN and reduces communication loss effectively.
Keyword:
Autonomous vehicles
Decision making
Path planning
Training
Optimal control
Deep learning
Complex systems
Autonomous driving
deep reinforcement learning
deep Q-network
event-triggered control
parallel control
期刊
I
IF:
14.3
论文数:
1.3K
被引数:
1.2W
机构
引用论文
.png){kind=icon}
Self-Learning Optimal Regulation for Discrete-Time Nonlinear Systems Under Event-Driven Formulation
PREAI
分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏Event-Triggered Near-Optimal Control for Unknown Discrete-Time Nonlinear Systems Using Parallel Control使用并行控制的未知离散时间非线性系统的事件触发近似最优控制
PREAI
分享收藏Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles深度强化学习在自主车辆运动规划中的应用综述
OAAI
OAAI分享收藏分享收藏
查看更多内容