arrow
Return

Physics-Informed Transfer Learning for Process Control Applications

delete2024-11-27
delete1
PRE
AI
S
Samuel Arce Muñoz
J
Jonathan Pershing
J
John D. Hedengren *
DOI:10.1021/acs.iecr.4c02781delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Advancements in deep learning tools originally designed for natural language processing are also applied to applications in the field of process control. Transformers, in particular, have been used to leverage self-attention mechanisms and effectively capture long-range dependencies. However, these architectures require extensive data representative of a specific process, which is not always available. To address this issue, transfer learning has emerged as a machine learning technique that enables pretrained models to adapt to new tasks with minimal additional training. This paper demonstrates a process that combines transfer learning with transformer architectures to enable a data-driven approach to control tasks, such as system identification and surrogate control modeling, when data are scarce. In this study, large amounts of data from a source system are used to train a transformer that models the dynamics of target systems for which limited data are available. The paper compares the predictive performance of models trained only on target system data with models using transfer learning including a modified transformer architecture with a physics-informed neural network (PINN) component. The results demonstrate improved predictive accuracy in system identification by up to 45% with transfer learning and up to 74% with both transfer learning and a PINN architecture. Similar accuracy improvements were observed in surrogate control tasks, with enhancements of up to 44% using transfer learning and up to 98% with transfer learning and a PINN architecture.
Keywords:
FRAMEWORK

Journal

I
Industrial and Engineering Chemistry Research
IF:
3.9
Papers:
4.0W
Citations:
9.6W

Organization

B
Brigham Young University
Scholars:
9.0K
Papers: 6.0K
Citations: 9.3K
Cited Papers

Cited Papers

Integrated Modeling of Transfer Learning and Intelligent Heuristic Optimization for a Steam Cracking Process
err2020-08-20
err19
errOAAI
errBi, Kexin; Beykal, Burcu; Avraamidou, Styliani; Pappas, Iosif; Pistikopoulos, Efstratios N.; Qiu, Tong
errShare
errSave
Deep Learning-Based Approximation of Model Predictive Control Laws Using Mixture Networks
err2025-01-01
err1
PREAI
errOkamoto, Morimasa; Ren, Jiayang; Mao, Qiangqiang; Liu, Jianfeng; Cao, Yankai
errShare
errSave
Transfer learning for smart buildings: A critical review of algorithms, applications, and future perspectives
err2022-02-01
err126
errOAAI
errPinto, Giuseppe; Wang, Zhe; Roy, Abhishek; Hong, Tianzhen; Capozzoli, Alfonso
errShare
errSave
Transformed l1 regularization for learning sparse deep neural networks
err2019-11-01
err77
PREAI
errMa, Rongrong; Miao, Jianyu; Niu, Lingfeng; Zhang, Peng
errShare
errSave
Transfer Learning for Non-Intrusive Load Monitoring
err2020-03-01
err175
errOAAI
errD'Incecco, Michele; Squartini, Stefano; Zhong, Mingjun
errShare
errSave
researcher View more