arrow
返回

Mobile Service Robot Path Planning Using Deep Reinforcement Learning

delete2023-01-01
delete10
delete
OA
AI
A
A. A. Nippun Kumaar *
S
Sreeja Kochuvila
DOI:10.1109/ACCESS.2023.3311519delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
A mobile service robot operates in a constantly changing environment with other robots and humans. The service environment is usually vast and unknown, and the robot is expected to operate continuously for a long period. The environment can be dynamic, leading to the generation of new routes or the permanent blocking of old routes. The traditional path planner that relies on static maps will not suffice for a dynamic environment. This work is focused on developing a reinforcement learning-based path planner for a dynamic environment. The proposed system uses the deep Q-Learning algorithm to learn the initial paths using a topological map of the environment. In an environmental change, the proposed beta-decay transfer learning algorithm trains the agent in the new environment. This algorithm uses experience vs. exploration vs. exploitation-based training depending on the similarity of the old and new environments. The system is implemented on the Robotic Operating System framework and tested using Turtlebot3 mobile robot in the Gazebo simulator. The experimental results show that the reinforcement learning system learns all the routes based on the initial topological map of different service environments with an accuracy of over 98%. A comparative analysis of the beta-decay transfer learning and non-transfer learning agents is performed based on various evaluation metrics. The transfer learning agent converges twice faster than the non-transfer learning agent.
Keyword:
Path planning
mobile robots
service robot
navigation systems
reinforcement learning
deep Q-Learning
transfer learning
dynamic environment
machine learning
artificial intelligence
incremental learning
lifelong learning

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

A
Amrita Vishwa Vidyapeetham
学者数:
7.0K
论文数: 4.2K
被引数: 3.3K
A
amrita vishwa vidyapeetham bengaluru
学者数:
237
论文数: 234
被引数: 0
引用论文

引用论文

Quantal Organization of Reflex and Conditioned Eyelid Responses
err1997-11-01
err0
PREAI
errJosé A. Domingo; Agnes Gruart; José M. Delgado-García
err分享
err收藏
Transferring knowledge as heuristics in reinforcement learning: A case-based approach强化学习中的启发式知识转移: 一种基于案例的方法
err2015-09-01
err55
errOAAI
errBianchi, Reinaldo A. C.; Celiberto, Luiz A., Jr.; Santos, Paulo E.; Matsuura, Jackson P.; Lopez de Mantaras, Ramon
err分享
err收藏
err分享
err收藏
err分享
err收藏
Remote Effect of Malignancy on the Nervous System in Children
err2008-11-12
err0
PREAI
errThaddeus W. Kurczynski; Amimul A. Choudhury; Samuel J. Horwitz; Uros Roessmann; Samuel Gross
err分享
err收藏
学者 查看更多内容