arrow
Return

Physics-based Penalization for Hyperparameter Estimation in Gaussian Process Regression

delete2023-10-01
delete6
delete
OA
AI
J
Jinhyeun Kim
K
Kamran Paynabar *
F
Fani Boukouvala *
DOI:10.1016/j.compchemeng.2023.108320delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
In Gaussian Process Regression (GPR), hyperparameters are often estimated by maximizing the marginal likelihood function. However, this data-dominant hyperparameter estimation process can lead to poor extrapolation performance and often violates known physics, especially in sparse data scenarios. In this paper, we embed physics-based knowledge through penalization of the marginal likelihood objective function and study the effect of this new objective on consistency of optimal hyperparameters and quality of GPR fit. Three case studies are presented, where physics-based knowledge is available in the form of linear Partial Differential Equations (PDEs), while initial or boundary conditions are not known so direct forward simulation of the model is challenging. The results reveal that the new hyperparameter set obtained from the augmented marginal likelihood function can improve the prediction performance of GPR, reduce the violation of the underlying physics, and mitigate overfitting problems.
Keywords:
Gaussian Process Regression
Maximum Likelihood Estimation
Physics-informed Machine Learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

C
Computers and Chemical Engineering
IF:
3.9
Papers:
8.1K
Citations:
1.7W

Organization

G
Georgia Institute of Technology
Scholars:
1.8W
Papers: 1.4W
Citations: 5.9W
U
university system of georgia
Scholars:
7.3W
Papers: 6.5W
Citations: 101