arrow
Return

Safe Efficient Policy Optimization Algorithm for Unsignalized Intersection Navigation

delete2024-09-01
delete0
PRE
AI
C
Chen, Xiaolong
B
Biao Xu *
M
Manjiang Hu
Y
Yougang Bian
Y
Yang Li
徐鑫 cover
徐鑫 (Xin Xu)
DOI:10.1109/JAS.2024.124287delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Unsignalized intersections pose a challenge for autonomous vehicles that must decide how to navigate them safely and efficiently. This paper proposes a reinforcement learning (RL) method for autonomous vehicles to navigate unsignalized intersections safely and efficiently. The method uses a semantic scene representation to handle variable numbers of vehicles and a universal reward function to facilitate stable learning. A collision risk function is designed to penalize unsafe actions and guide the agent to avoid them. A scalable policy optimization algorithm is introduced to improve data efficiency and safety for vehicle learning at intersections. The algorithm employs experience replay to overcome the on-policy limitation of proximal policy optimization and incorporates the collision risk constraint into the policy optimization problem. The proposed safe RL algorithm can balance the trade-off between vehicle traffic safety and policy learning efficiency. Simulated intersection scenarios with different traffic situations are used to test the algorithm and demonstrate its high success rates and low collision rates under different traffic conditions. The algorithm shows the potential of RL for enhancing the safety and reliability of autonomous driving systems at unsignalized intersections.
Keywords:
Navigation
Semantics
Reinforcement learning
Safety
Reliability
Optimization
Autonomous vehicles
Autonomous driving
decision-making
reinforcement learning (RL)
unsignalized intersection

Journal

I
IEEE-CAA Journal of Automatica Sinica
IF:
19.2
Papers:
1.4K
Citations:
1.1W

Organization

H
hunan university
Scholars:
4.5W
Papers: 3.3W
Citations: 70
N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9