返回
Learning Robust Predictive Control: A Spatial–Temporal Game Theoretic Approach
DOI:10.1109/TNNLS.2024.3357238.png)
摘要
En 中文
This article investigates robust predictive control problem for unknown dynamical systems. Since the dynamics unavailability restricts feasibility of model-driven methods, learning robust predictive control (LRPC) framework is developed from the aspect of time consistency. Under feedback-like control causality, the robust predictive control is then reconstructed as spatialbKKtemporal games, and we guarantee stability through time-consistent Nash equilibrium. For gradation clarity, our framework is specified as four-follow contents. First, multistep feedback-like control causality is drawn from time series analysis, and Takens' theorem provides theoretical support from steady-state property. Second, control problem is reconstructed as games, while performance and robustness partition the game into temporal nonzero-sum subgames and spatial zero-sum ones, respectively. Next, multistep reinforcement learning (RL) is designed to solve robust predictive control without system model. Convergence is proven through bounds analysis of oscillatory value functions, and properties of receding horizon are derived from time consistency. Finally, data-driven implementation is given with function approximation, and neural networks are chosen to approximate value functions and feedback-like causality. Weights are estimated with least squares errors. Numerical results verify the effectiveness.
Keyword:
Game theory
optimal control
reinforcement learning (RL)
robust predictive control
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
A Computationally Efficient Robust Model Predictive Control Framework for Uncertain Nonlinear Systems不确定非线性系统的计算效率高的鲁棒模型预测控制框架
Adaptive dynamic programming and optimal control of nonlinear nonaffine systems自适应动态规划与非线性非仿射系统的最优控制
AUTOMATICA
IF5.9
Optimal Control for Unknown Discrete-Time Nonlinear Markov Jump Systems Using Adaptive Dynamic Programming基于自适应动态规划的未知离散非线性Markov跳变系统最优控制
Continuity Scaling: A Rigorous Framework for Detecting and Quantifying Causality Accurately
RESEARCH
IF10.7

