arrow
Return

Multipath Planning Acceleration Method With Double Deep R-Learning Based on a Genetic Algorithm

delete2023-10-01
delete5
PRE
AI
E
Elizabeth Palacios-Morocho *
S
Saúl Inca
J
José F. Monserrat
DOI:10.1109/TVT.2023.3277981delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Autonomous navigation is a well-studied field in robotics requiring high standards of efficiency and reliability. Many studies focus on applying AI techniques to obtain a high-quality map, a precise localization, or improve the proposed trajectory to be followed by the agent. As traditional planning methods need a high-quality map to obtain optimal trajectories, this paper addresses the problem of multipath map-less planning, and proposes a novel multipath planning algorithm (Double Deep Reinforcement Learning - Enhanced Genetic (DDRL-EG)) for mobile robots in an unknown environment. It combines Double Deep Reinforcement Learning (DDRL) with Heuristic Knowledge (HK), Experience Replay (ER), Genetic Algorithm (GA), and Dynamic Programming (DP), allowing the agent to reach its target successfully without maps. In addition, it optimizes the training time and the chosen path in terms of time and distance to the target. A hybrid method is also used in which Semi-Uniform Distributed Exploration (SUDE) is employed to determine the probability that the action is decided based on directed knowledge, hybrid knowledge, or autonomous knowledge. The performance of DDRL-EG is compared with two other algorithms in two different environments. The results show that DDRL-EG is a more robust and powerful algorithm since with less training, it can provide much smoother and shorter trajectories to the target.
Keywords:
Reinforcement learning
dynamic programming
prioritized experience
heuristic knowledge
genetic algorithm

Journal

IEEE Transactions on Vehicular Technology cover
IEEE Transactions on Vehicular Technology
IF:
7.1
Papers:
1.8W
Citations:
6.6W

Organization

U
Universitat Politecnica de Valencia
Scholars:
1.5W
Papers: 1.4W
Citations: 18
Cited Papers

Cited Papers

Path Planning for Active SLAM Based on the D* Algorithm With Negative Edge Weights
err2018-08-01
err87
PREAI
errMaurovic, Ivan; Seder, Marija; Lenac, Kruno; Petrovic, Ivan
errShare
errSave
MEC-Assisted Immersive VR Video Streaming Over Terahertz Wireless Networks: A Deep Reinforcement Learning Approach
err2020-10-01
err223
errOAAI
errDu, Jianbo; Yu, F. Richard; Lu, Guangyue; Wang, Junxuan; Jiang, Jing; Chu, Xiaoli
errShare
errSave
Corticosterone impairs dendritic cell maturation and function
err2007-05-10
err0
errOAAI
errMichael D. Elftman; Christopher C. Norbury; Robert H. Bonneau; Mary E. Truckenmiller
errShare
errSave
A Survey of Embodied AI: From Simulators to Research Tasks
err2022-04-01
err127
errOAAI
errDuan, Jiafei; Yu, Samson; Tan, Hui Li; Zhu, Hongyuan; Tan, Cheston
errShare
errSave
researcher View more