arrow
返回

Autonomous Driving Based on Approximate Safe Action

delete2023-12-01
delete7
PRE
AI
X
Xuesong Wang
J
Jiazhi Zhang
D
Diyuan Hou
Y
Yuhu Cheng *
DOI:10.1109/TITS.2023.3292253delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Safety limits the application of traditional reinforcement learning (RL) methods to autonomous driving. To address the challenge of safe exploration in autonomous driving tasks, a novel safe RL method called Twin Delayed Deep Deterministic Policy Gradient based on Approximate Safe Action (TD3-ASA) is proposed in this paper. In TD3-ASA, the action output by the current policy during the exploration process is modified to obtain an approximate safe action, and then the approximate safe action is utilized to train a safe policy for deployment. TD3-ASA offers several advantages: 1) TD3-ASA is sample efficient and does not need any prior knowledge; 2) TD3-ASA enhances safety both during training and deployment; 3) TD3-ASA introduces an adjustable safety correction factor that enables a tradeoff between exploration and safety. Experimental results conducted on both the MetaDrive and SpeedLimit autonomous driving test platforms demonstrate the effectiveness of TD3-ASA. TD3-ASA exhibits more than triple safety during training on MetaDrive compared to the current state-of-the-art RL method, achieving a high success rate and low deployment risk.
Keyword:
Autonomous driving
approximate safe action
safe reinforcement learning
safety correction factor

期刊

IEEE Transactions on Intelligent Transportation Systems 封面图
IEEE Transactions on Intelligent Transportation Systems
IF:
8.4
论文数:
9.7K
被引数:
6.3W

机构

暂无机构信息
引用论文

引用论文

Conflict-Aware Safe Reinforcement Learning: A Meta-Cognitive Learning Framework
err2022-03-01
err17
PREAI
errMazouchi, Majid; Nageshrao, Subramanya; Modares, Hamidreza
err分享
err收藏
Transport properties of polyimides containing phenylquinoxaline moieties
err2007-09-01
err0
PREAI
errM. N. Vidyakin; Yu. N. Lazareva; Yu. P. Yampol’skii; A. Yu. Alentiev; I. A. Ronova; M. Bruma; E. Hamciuc; R. Lungu
err分享
err收藏
Gaseous bromine and particulate lead, vanadium, and bromine in a polluted atmosphere
err2002-05-01
err0
PREAI
errJarvis L. Moyers; William H. Zoller; Robert A. Duce; Gerald L. Hoffman
err分享
err收藏
err分享
err收藏
学者 查看更多内容