arrow
返回

Mobile Robot Path Planning Using a QAPF Learning Algorithm for Known and Unknown Environments

delete2022-01-01
delete51
delete
OA
AI
U
Ulises Orozco-Rosas *
K
Kenia Picos
J
Juan José Pantrigo
A
Antonio S. Montemayor
A
Alfredo Cuesta‐Infante
DOI:10.1109/ACCESS.2022.3197628delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper presents the computation of feasible paths for mobile robots in known and unknown environments using a QAPF learning algorithm. Q-learning is a reinforcement learning algorithm that has increased in popularity in mobile robot path planning in recent times, due to its self-learning capability without requiring a priori model of the environment. However, Q-learning shows slow convergence to the optimal solution, notwithstanding such an advantage. To address this limitation, the concept of partially guided Q-learning is employed wherein, the artificial potential field (APF) method is utilized to improve the classical Q-learning approach. Therefore, the proposed QAPF learning algorithm for path planning can enhance learning speed and improve final performance using the combination of Q-learning and the APF method. Criteria used to measure planning effectiveness include path length, path smoothness, and learning time. Experiments demonstrate that the QAPF algorithm successfully achieves better learning values that outperform the classical Q-learning approach in all the test environments presented in terms of the criteria mentioned above in offline and online path planning modes. The QAPF learning algorithm reached an improvement of 18.83% in path length for the online mode, an improvement of 169.75% in path smoothness for the offline mode, and an improvement of 74.84% in training time over the classical approach.
Keyword:
Q-learning
Path planning
Mobile robots
Heuristic algorithms
Reinforcement learning
Path planning
Q-learning
artificial potential field
reinforcement learning
mobile robots

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
Universidad Rey Juan Carlos
学者数:
6.2K
论文数: 6.2K
被引数: 6.7K
引用论文

引用论文

Path Planning Method With Improved Artificial Potential Field-A Reinforcement Learning Perspective基于强化学习视角的改进人工势场路径规划方法
err2020-01-01
err116
errOAAI
errYao, Qingfeng; Zheng, Zeyu; Qi, Liang; Yuan, Haitao; Guo, Xiwang; Zhao, Ming; Liu, Zhi; Yang, Tianji
err分享
err收藏
Controlling self-healing of optical field based on moiré dual-microlens arrays
err2023-08-11
err0
errOAAI
errDongwei Li; Weiming Wang; Song Gao; Yuanmei Gao; Yangjian Cai; Zuoqiang Hao; Zengrun Wen
err分享
err收藏
UAV Path Planning Using Optimization Approaches: A Survey使用优化方法的无人机路径规划: 综述
err2022-04-18
err77
PREAI
errSaadi, Amylia Ait; Soukane, Assia; Meraihi, Yassine; Gabis, Asma Benmessaoud; Mirjalili, Seyedali; Ramdane-Cherif, Amar
err分享
err收藏
err分享
err收藏
err分享
err收藏
Glycoprotein G-protein Coupled Receptors in Disease: Luteinizing Hormone Receptors and Follicle Stimulating Hormone Receptors
err2020-09-15
err0
errOAAI
errDuaa Althumairy; Xiaoping Zhang; Nicholas Baez; George Barisas; Deborah A. Roess; George R. Bousfield; Debbie C. Crans
err分享
err收藏
Cost-Benefit Analysis
err
IF0
err2007-05-07
err0
PREAI
errEuston Quah; E.J. Mishan; Euston Quah
err分享
err收藏
学者 查看更多内容