.png){kind=icon}
返回
Autonomous Platoon Control With Integrated Deep Reinforcement Learning and Dynamic Programming
.png){kind=icon}
OA
AI
DOI：10.1109/JIOT.2022.3222128.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Autonomous vehicles in a platoon determine the control inputs based on the system state information collected and shared by the Internet of Things (IoT) devices. Deep reinforcement learning (DRL) is regarded as a potential method for car-following control and has been mostly studied to support a single following vehicle. However, it is more challenging to learn an efficient car-following policy with convergence stability when there are multiple following vehicles in a platoon, especially with unpredictable leading vehicle behavior. In this context, we adopt an integrated DRL and dynamic programming (DP) approach to learn autonomous platoon control policies, which embeds the deep deterministic policy gradient (DDPG) algorithm into a finite-horizon value iteration framework. Although the DP framework can improve the stability and performance of DDPG, it has the limitations of lower sampling and training efficiency. In this article, we propose an algorithm, namely, finite-horizon-DDPG with sweeping through reduced state space using stationary approximation (FH-DDPG-SS), which uses three key ideas to overcome the above limitations, i.e., transferring network weights backward in time, stationary policy approximation for earlier time steps, and sweeping through reduced state space. In order to verify the effectiveness of FH-DDPG-SS, simulation using real driving data is performed, where the performance of FH-DDPG-SS is compared with those of the benchmark algorithms. Finally, platoon safety and string stability for FH-DDPG-SS are demonstrated.
Keyword:
Training
Stability analysis
Aerospace electronics
Internet of Things
Vehicle dynamics
Safety
Reinforcement learning
Deep reinforcement learning (DRL)
dynamic programming (DP)
platoon control
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
Cooperative Adaptive Cruise Control: Network-Aware Analysis of String Stability协同自适应巡航控制: 弦稳定性的网络感知分析
OAAI
OAAI分享收藏Critical Evaluation and Thermodynamic Optimization of the Li2O-Al2O3 and Li2O-MgO-Al2O3 Systems
PREAI
分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏The effects of Berberis vulgaris fruit extract on serum lipoproteins, apoB, apoA-I, homocysteine, glycemic control and total antioxidant capacity in type 2 diabetic patientsBerberis vulgaris果提取物对血清脂蛋白、apoB、apoA-I、同型半胱氨酸、血糖控制和总抗氧化能力的影响在2型糖尿病患者中的作用.png)
IF0
PREAI
分享收藏
查看更多内容