返回
Asynchronous iterative Q-learning based tracking control for nonlinear discrete-time multi-agent systems
DOI:10.1016/j.neunet.2024.106667.png)
摘要
En 中文
This paper addresses the tracking control problem of nonlinear discrete-time multi-agent systems (MASs). First, a local neighborhood error system (LNES) is constructed. Then, a novel tracking algorithm based on asynchronous iterative Q-learning (AIQL) is developed, which can transform the tracking problem into the optimal regulation of LNES. The AIQL-based algorithm has two Q values Q(i)(A) and Q(i)(B) for each agent i , where Q(i)(A) is used for improving the control policy and Q(i)(B) is used for evaluating the value of the control policy. Moreover, the convergence of LNES is given. It is shown that the LNES converges to 0 and the tracking problem is solved. A neural network-based actor-critic framework is used to implement AIQL. The critic network of AIQL is composed of two neural networks, which are used for approximating Q(i)(A) and Q(i)(B) respectively. Finally, simulation results are given to verify the performance of the developed algorithm. It is shown that the AIQLbased tracking algorithm has a lower cost value and faster convergence speed than the IQL-based tracking algorithm.
Keyword:
Multi-agent
Discrete-time
Asynchronous iterative Q-learning
Tracking control
期刊
IF:
6.3
论文数:
7.9K
被引数:
3.0W
机构
引用论文
A novel policy iteration based deterministic Q-learning for discrete-time nonlinear systems基于策略迭代的离散时间非线性系统确定性Q学习
Robust optimal tracking control for multiplayer systems by off-policy Q-learning approach基于非策略Q学习方法的多人系统鲁棒最优跟踪控制
Does modified Otago Exercise Program improves balance in older people? A systematic review改良的奥塔哥锻炼计划能改善老年人的平衡吗?一项系统综述
Finite-time consensus control for multi-agent systems with full-state constraints and actuator failures
NEURAL NETWORKS
IF6.3

