arrow
Return

Data-Based Predictive Control via Multistep Policy Gradient Reinforcement Learning

delete2023-05-01
delete16
PRE
AI
X
Xindi Yang
张浩 cover
张浩 (Hao Zhang)
Z
Zhuping Wang *
严怀成 cover
严怀成 (Huaicheng Yan)
C
Changzhu Zhang
DOI:10.1109/TCYB.2021.3121078delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In this article, a model-free predictive control algorithm for the real-time system is presented. The algorithm is data driven and is able to improve system performance based on multistep policy gradient reinforcement learning. By learning from the offline dataset and real-time data, the knowledge of system dynamics is avoided in algorithm design and application. Cooperative games of the multiplayer in time horizon are presented to model the predictive control as optimization problems of multiagent and guarantee the optimality of the predictive control policy. In order to implement the algorithm, neural networks are used to approximate the action-state value function and predictive control policy, respectively. The weights are determined by using the methods of weighted residual. Numerical results show the effectiveness of the proposed algorithm.
Keywords:
Predictive control
Real-time systems
Predictive models
Prediction algorithms
Reinforcement learning
Games
Cost function
Cooperative games
multistep reinforcement learning (RL)
policy gradient methods
predictive control

Journal

IEEE Transactions on Cybernetics cover
IEEE Transactions on Cybernetics
IF:
10.5
Papers:
1.1W
Citations:
5.0W

Organization

T
tongji university
Scholars:
7.9W
Papers: 6.0W
Citations: 98
Cited Papers

Cited Papers

Off-Policy Actor-Critic Structure for Optimal Control of Unknown Systems With Disturbances
err2016-05-01
err196
PREAI
errSong, Ruizhuo; Lewis, Frank L.; Wei, Qinglai; Zhang, Huaguang
errShare
errSave
Distributed Services Attestation in IoT
err2018-11-30
err0
PREAI
errMauro Conti; Edlira Dushku; Luigi V. Mancini
errShare
errSave
researcher View more