arrow
返回

Physics-Informed Transfer Learning for Process Control Applications

delete2024-11-27
delete1
PRE
AI
S
Samuel Arce Muñoz
J
Jonathan Pershing
J
John D. Hedengren *
DOI:10.1021/acs.iecr.4c02781delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Advancements in deep learning tools originally designed for natural language processing are also applied to applications in the field of process control. Transformers, in particular, have been used to leverage self-attention mechanisms and effectively capture long-range dependencies. However, these architectures require extensive data representative of a specific process, which is not always available. To address this issue, transfer learning has emerged as a machine learning technique that enables pretrained models to adapt to new tasks with minimal additional training. This paper demonstrates a process that combines transfer learning with transformer architectures to enable a data-driven approach to control tasks, such as system identification and surrogate control modeling, when data are scarce. In this study, large amounts of data from a source system are used to train a transformer that models the dynamics of target systems for which limited data are available. The paper compares the predictive performance of models trained only on target system data with models using transfer learning including a modified transformer architecture with a physics-informed neural network (PINN) component. The results demonstrate improved predictive accuracy in system identification by up to 45% with transfer learning and up to 74% with both transfer learning and a PINN architecture. Similar accuracy improvements were observed in surrogate control tasks, with enhancements of up to 44% using transfer learning and up to 98% with transfer learning and a PINN architecture.
Keyword:
FRAMEWORK

期刊

I
Industrial and Engineering Chemistry Research
IF:
3.9
论文数:
4.0W
被引数:
9.6W

机构

B
Brigham Young University
学者数:
9.0K
论文数: 6.0K
被引数: 9.3K
引用论文

引用论文

Integrated Modeling of Transfer Learning and Intelligent Heuristic Optimization for a Steam Cracking Process
err2020-08-20
err19
errOAAI
errBi, Kexin; Beykal, Burcu; Avraamidou, Styliani; Pappas, Iosif; Pistikopoulos, Efstratios N.; Qiu, Tong
err分享
err收藏
Transfer learning for smart buildings: A critical review of algorithms, applications, and future perspectives
err2022-02-01
err126
errOAAI
errPinto, Giuseppe; Wang, Zhe; Roy, Abhishek; Hong, Tianzhen; Capozzoli, Alfonso
err分享
err收藏
Transformed l1 regularization for learning sparse deep neural networks
err2019-11-01
err77
PREAI
errMa, Rongrong; Miao, Jianyu; Niu, Lingfeng; Zhang, Peng
err分享
err收藏
Transfer Learning for Non-Intrusive Load Monitoring
err2020-03-01
err175
errOAAI
errD'Incecco, Michele; Squartini, Stefano; Zhong, Mingjun
err分享
err收藏
学者 查看更多内容