.png){kind=icon}
返回
The Experience-Memory Q-Learning Algorithm for Robot Path Planning in Unknown Environment
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2020.2978077.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In order to solve the problem of slow convergence speed and long planned path when the robot plans a path in unknown environment by using Q-learning algorithm, we propose the Experience-Memory Q-Learning (EMQL) algorithm based on the continuous update of the shortest distance from the current state node to the start point. The autonomous learning ability of the robot is enhanced by the different role assignments of two tables in the proposed algorithm. EM table with (m*1) dimension is designed to record the distance information, reflecting the learning process of the robot. Q table is adopted as an auxiliary guidance for the experience transfer strategy and experience reuse strategy, and these strategies enable the robot accomplish the task even if the destination is changed or the path is blocked. Further, the learning efficiency of the robot in the EMQL algorithm is improved by the dual reward mechanism consisting of static reward and dynamic reward. The static reward is designed to prevent the robot from exploring a state node excessively. The dynamic reward is responsible for helping the robot avoid searching blindly in unknown environment. We test the effectiveness of the proposed algorithm on both grid maps and road network maps. The comparison results in planning time, iteration times and path length show that the performance of the EMQL algorithm is superior to Q-learning algorithm in convergence speed and optimization ability. Additionally, the practicability of the proposed algorithm is validated in a real-world experiment using the Turtlebot3 burger robot.
Keyword:
Path planning
Q-learning
experience memory
experience transfer
experience reuse
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Reconnaissance Mission Conducted by UAV Swarms Based on Distributed PSO Path Planning Algorithms基于分布式PSO路径规划算法的无人机群侦察任务.png)
IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏An Efficient Spatial Representation for Path Planning of Ground Robots in 3D EnvironmentsIEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏Evolving Rule-Based Explainable Artificial Intelligence for Unmanned Aerial Vehicles基于规则的可解释的无人机人工智能IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏分享收藏
查看更多内容