arrow
Return

Learning Distributed Predictive Control via Spatial-Temporal Games

delete2024-01-01
delete1
PRE
AI
Z
Zhuping Wang
L
Liu, Peijiang
H
Hongliang Ren
张浩 cover
张浩 (Hao Zhang)
X
Xindi Yang *
DOI:10.1109/TIE.2024.3454799delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This article investigates learning predictive control framework for multiagent systems with unknown dynamics. Predictive control, which generates temporal control inputs, provides potential applications in observation loss scenarios. First, control causality is inversely extracted from time series analysis, and predictive control is characterized as sequential feedback control. Next, we focus on distributed communication and time consistency under the causality. Distributed predictive control is equivalently partitioned into spatial and temporal subgames, respectively. Spatial subgames achieve equivalence between global and local objectives through Nash equilibrium, while temporal ones force local control causality to achieve stability and optimality with time consistency. Furthermore, a multistep reinforcement learning algorithm is proposed for data-driven implementation, and dynamics knowledge is avoided with interactive data. The learning properties are discussed with theoretical proof and parameters selection. Finally, we pose numerical results to demonstrate effectiveness, and robotics experiments are also carried out to show potential advantage under observation loss scenarios.
Keywords:
Control causality detection
multiagent game
predictive control
reinforcement learning
Control causality detection
multiagent game
predictive control
reinforcement learning

Journal

IEEE Transactions on Industrial Electronics cover
IEEE Transactions on Industrial Electronics
IF:
7.2
Papers:
1.8W
Citations:
9.8W

Organization

C
Chinese University of Hong Kong
Scholars:
3.4W
Papers: 3.2W
Citations: 5.6W
Cited Papers

Cited Papers

No cited papers available