arrow
返回

Double Q-PID algorithm for mobile robot control

delete2019-12-01
delete38
PRE
AI
I
Ignacio Carlucho
M
Mariano De Paula *
G
Gerardo G. Acosta
DOI:10.1016/j.eswa.2019.06.066delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Many expert systems have been developed for self-adaptive PID controllers of mobile robots. However, the high computational requirements of the expert systems layers, developed for the tuning of the PID controllers, still require previous expert knowledge and high efficiency in algorithmic and software execution for real-time applications. To address these problems, in this paper we propose an expert agent based system, based on a reinforcement learning agent, for self-adapting multiple low-level PID controllers in mobile robots. For the formulation of the artificial expert agent, we develop an incremental model-free algorithm version of the double Q-Learning algorithm for fast on-line adaptation of multiple low-level PID controllers. Fast learning and high on-line adaptability of the artificial expert agent is achieved by means of a proposed incremental active-learning exploration-exploitation procedure, for a non-uniform state space exploration, along with an experience replay mechanism for multiple value functions updates in the double Q-Iearning algorithm. A comprehensive comparative simulation study and experiments in a real mobile robot demonstrate the high performance of the proposed algorithm for a real-time simultaneous tuning of multiple adaptive low-level PID controllers of mobile robots in real world conditions. (C) 2019 Elsevier Ltd. All rights reserved.
Keyword:
Reinforcement learning
Double Q-learning
Incremental learning
Double Q-PID
Mobile robots
Multi-platforms
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

暂无机构信息
引用论文

引用论文

Conical diffraction in honeycomb lattices
err2009-05-18
err0
PREAI
errMark J. Ablowitz; Sean D. Nixon; Yi Zhu
err分享
err收藏
Physical Activity in Community‐Dwelling Stroke Survivors and a Healthy Population Is Not Explained by Motor Function Only
err2013-08-23
err0
PREAI
errAnna Danielsson; Cristiane Meirelles; Carin Willen; Katharina Stibrant Sunnerhagen
err分享
err收藏
err分享
err收藏
Spinal Block with 1.5 mg Hyperbaric Bupivacaine: Not Successful for Everyone
err2007-11-01
err0
errOAAI
errMichele Carron; Ulderico Freo; Stefano Veronese; Federico Innocente; Carlo Ori
err分享
err收藏
PID tuning with exact gain and phase margins
err1999-07-01
err72
PREAI
errWang, QG; Fung, HW; Zhang, Y
err分享
err收藏
学者 查看更多内容