arrow
Return

Q-learning algorithm in solving consensusability problem of discrete-time multi-agent systems

delete2021-06-01
delete14
PRE
AI
T
Tao Feng
J
Jilie Zhang *
Y
Yin Tong
张化光 cover
张化光 (Huaguang Zhang)
DOI:10.1016/j.automatica.2021.109576delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper solves the consensusability problem for the single-input discrete-time multi-agent system (MAS) over directed graphs by the linear quadratic regulator (LQR) design method. It is proved that the maximum consensus region is exactly the largest gain margin (GM) of LQR. Based on this, the necessary and sufficient condition on consensusability is derived by solving a standard algebraic Riccati equation (ARE). The developed framework permits that the consensusability problem can be solved when the agents' models are completely unavailable. Q-learning algorithm is employed to compute the maximum consensus region and implement the consensus protocol design. The algorithm runs only on a single agent rather than the intercommunicating MAS hence the unattainable initial admissible protocols are not required. A numerical example is given to illustrate the effectiveness of the developed methods. (c) 2021 Elsevier Ltd. All rights reserved.
Keywords:
Consensusability
Consensus region
Linear quadratic regulator (LQR)
Q-learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Automatica cover
Automatica
IF:
5.9
Papers:
1.2W
Citations:
5.2W

Organization

S
Southwest Jiaotong University
Scholars:
2.9W
Papers: 2.1W
Citations: 2.3W
Cited Papers

Cited Papers

H∞ almost state synchronization for homogeneous networks of non-introspective agents: A scale-free protocol design
err2020-12-01
err17
errOAAI
errLiu, Zhenwei; Saberi, Ali; Stoorvogel, Anton A.; Nojavanzadeh, Donya
errShare
errSave
Synchronization of discrete-time multi-agent systems on graphs using Riccati design
err2013-02-01
err182
PREAI
errHengster-Movric, Kristian; You, Keyou; Lewis, Frank L.; Xie, Lihua
errShare
errSave
researcher View more