arrow
返回

Model Predictive Control-Based Reinforcement Learning Using Expected Sarsa

delete2022-01-01
delete3
delete
OA
AI
H
Hoomaan MoradiMaryamnegari
M
Marco Frego
A
Angelika Peer *
DOI:10.1109/ACCESS.2022.3195530delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Recent studies have shown the potential of Reinforcement Learning (RL) algorithms in tuning the parameters of Model Predictive Controllers (MPC), including the weights of the cost function and unknown parameters of the MPC model. However, a framework for easy and straightforward implementation that allows training in just a few episodes and overcoming the need for imposing extra constraints as required by state-of-the-art methods, is still missing. In this study, we present two implementations to achieve these goals. In the first approach, a nonlinear MPC plays the role of a function approximator for an Expected Sarsa RL algorithm. In the second approach, only the MPC cost function is considered as the function approximator, while the unknown parameters of the MPC model are updated based on more classical system identification. In order to evaluate the performance of the proposed algorithms, first numerical simulations are performed on a coupled tanks system. Then, both algorithms are applied to the real system and their closed-loop performance and convergence speed are compared with each other. The results indicate that the proposed algorithms allow tuning of MPCs over very few episodes. Finally, also the disturbance rejection ability of the proposed methods is demonstrated.
Keyword:
Q-learning
Computational modeling
Training
Prediction algorithms
Mathematical models
Costs
Cost function
Model predictive control
reinforcement learning
expected Sarsa algorithm
model-based learning method

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
36.3W

机构

F
free university of bozen–bolzano
学者数:
7
论文数: 4
被引数: 0
引用论文

引用论文

Preoperative Mild Pericardial Effusion Is Associated With Perioperative Complications In Elderly Patients Following Hip Fracture Surgery
err2019-09-01
err0
PREAI
errAhmet Emrah Açan; Emre Gültaç; Cem Yalın Kılınç; Bülent Özlek; Onur Gürsan; Murat Biteker
err分享
err收藏
err分享
err收藏
err分享
err收藏
Ribosome protection by ABC‐F proteins—Molecular mechanism and potential drug design
err2019-03-04
err0
errOAAI
errRya Ero; Veerendra Kumar; Weixin Su; Yong‐Gui Gao
err分享
err收藏
Telehealth in Physical Medicine and Rehabilitation: A Narrative Review
err2017-05-18
err0
PREAI
errAdam S. Tenforde; Jaye E. Hefner; Jodi E. Kodish‐Wachs; Mary A. Iaccarino; Sabrina Paganoni
err分享
err收藏
学者 查看更多内容