.png){kind=icon}
返回
A practically implementable reinforcement learning control approach by leveraging offset-free model predictive control
.png){kind=icon}
PRE
AI
DOI：10.1016/j.compchemeng.2023.108511.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This work addresses the problem of designing an offset-free implementable reinforcement learning (RL) controller for nonlinear processes. RL-based controllers can update the control policy using observed data obtained online based on the controller-process interactions. This allows to alleviate the regular model maintenance step that is essential in advanced control techniques such as model predictive control (MPC). However, random explorations are required for an RL agent to find optimal state-action regions so as to finally reach the optimal policy. This is not implementable in practical situations due to safety concerns and economic objectives. To address this issue, a pre-training strategy is proposed to provide a secure platform for online implementations of the RL controllers. To this end, an offset-free MPC (representative industrial MPC) optimization problem is leveraged to train the RL agent offline. Having obtained similar performance to the offset-free MPC, the RL agent is utilized for online control to interact with the actual process. The efficacy of the proposed approach to handle nonlinearity and changes in plant operating conditions (due to unmeasured disturbances) are demonstrated through simulations on a chemical reactor example for a pH neutralization process. The results show that the proposed RL controller can significantly improve the oscillatory closed -loop responses, obtained by running the offset-free MPC due to the plant-model mismatch and unmeasured disturbances.
Keyword:
Reinforcement learning
Machine learning
Offset-free model predictive control
Process control
期刊
C
IF:
3.9
论文数:
8.1K
被引数:
1.7W
机构
引用论文
Reinforced model predictive control (RL-MPC) for building energy management用于建筑能源管理的增强型模型预测控制 (rl-mpc).png)
APPLIED ENERGY
OAAI
APPLIED ENERGYIF11
OAAI分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏Model predictive control of nonlinear processes using neural ordinary differential equation models使用神经常微分方程模型对非线性过程进行模型预测控制
PREAI
分享收藏
查看更多内容