arrow
Return

AUV Dynamic Obstacle Avoidance Method Based on Improved PPO Algorithm

delete2022-01-01
delete22
delete
OA
AI
G
Guohao Zhu
L
Laiyuan Liu
S
Sicong Zhao
F
Fangzheng Ji
Z
Zixia Ju
J
Jialong Sun *
DOI:10.1109/ACCESS.2022.3223382delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Designing a reasonable obstacle avoidance method for AUV 3D path planning is difficult, and existing obstacle avoidance methods have certain drawbacks. For example, they are only applicable to 2D planar applications and cannot effectively handle dynamic obstacles. To address these problems, we design an obstacle collision prediction model (CPM). Based on the results of the simulation of obstacles' inertial motion, the safety of the AUV navigation is evaluated to improve the model's sensitivity to dynamic obstacles. Then, we enhance the learning ability of the sequence sample data by combining it with a long short-term memory (LSTM) network, thus improving the training efficiency and effect of the algorithm. The trained proximal policy optimization (PPO) network can output reasonable actions in order to control the AUV to avoid obstacles, forming an AUV 3D dynamic obstacle avoidance strategy based on the CPM-LSTM-PPO algorithm. The simulation results show that the proposed algorithm has good generalization in uncertain environments. Moreover, it achieves dynamic AUV obstacle avoidance in different three-dimensional unknown environments, providing theoretical and technical support for real path planning.
Keywords:
AUV
dynamic obstacle avoidance
deep reinforcement learning
proximal policy optimization algorithm
collision prediction model

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

J
jiangsu ocean university
Scholars:
4.4K
Papers: 2.0K
Citations: 2
Cited Papers

Cited Papers

Stuttering or reflex seizure? A case report
err2004-09-01
err0
PREAI
errVéronique Michel; Pierre Burbaud; Jacques Taillard; Tsouria Gaida; Pierre Alain Joseph; Bernard Duché; Bernard Bioulac
errShare
errSave
Dam Structure Deformation Monitoring by GB-InSAR Approach
err2020-01-01
err31
errOAAI
errQiu, Zhiwei; Jiao, Minglian; Jiang, Tinchen; Zhou, Li
errShare
errSave
Average Peak Age of Information in Underwater Information Collection With Sleep-Scheduling
err2022-09-01
err25
PREAI
errFang, Zhengru; Wang, Jingjing; Jiang, Chunxiao; Wang, Xijun; Ren, Yong
errShare
errSave
Moderate effect of damming the Romaine River (Quebec, Canada) on coastal plankton dynamics
err2018-04-01
err0
errOAAI
errSimon Senneville; Irene R. Schloss; Simon St-Onge Drouin; Simon Bélanger; Gesche Winkler; Dany Dumont; Patricia Johnston; Isabelle St-Onge
errShare
errSave
Molecular simulation study on the rheological properties of a pH-responsive clean fracturing fluid system
errFUEL
IF7.5
err2019-10-01
err30
PREAI
errZhao, Guang; Yan, Zhihu; Qian, Feng; Sun, Haonan; Lu, Xia; Fan, Haiming
errShare
errSave
Food Safety Standards, Trade & WTO
err2008-10-01
err0
PREAI
errKhushdeep Dharni; Sonika Sharma
errShare
errSave
errShare
errSave
researcher View more