.png){kind=icon}
返回
Embedding active learning in batch-to-batch optimization using reinforcement learning
.png){kind=icon}
PRE
AI
DOI：10.1016/j.automatica.2023.111260.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Batch-to-batch (B2B) or run-to-run (R2R) optimization refers to the strategy of updating the operating parameters of a batch run based on the results of previous runs and exploits the repetitive nature of batch process operation. Although B2B optimization uses feedback from previous batch runs to learn about model uncertainty and improve the operation of future runs, the standard techniques have the limitations of passive learning and being myopic in making adjustments. This work proposes a novel way to use the reinforcement learning approach to embed the active learning feature into B2B optimization. For this, the B2B optimization problem is formulated as a maximization of a long-term performance of repeated batch runs, which are modeled as a stochastic process with uncertain parameters. To solve the resulting Bayes-Adaptive Markov decision process (BAMDP) problem in a near-optimal manner, a policy gradient reinforcement learning algorithm is employed. Through case studies, the behavior and effectiveness of the proposed B2B optimization method are examined by comparing it with the traditional certainty equivalence based B2B optimization method with passive learning.& COPY; 2023 Elsevier Ltd. All rights reserved.
Keyword:
Batch process optimization
Batch-to-batch optimization
Reinforcement learning
Active learning
Hyper-state
Optimization under uncertainty
Model-plant mismatch
Bayes-Adaptive Markov decision process
期刊
IF:
5.9
论文数:
1.2W
被引数:
5.2W
机构
引用论文
.png){kind=icon}
Survey on iterative learning control, repetitive control, and run-to-run control迭代学习控制、重复控制和运行间控制综述
PREAI
分享收藏分享收藏ICT for informal workers in Sub-Saharan Africa: Systematic review and analysis撒哈拉以南非洲非正规工人的信通技术: 系统回顾和分析
PREAI
分享收藏
查看更多内容