arrow
Return

Theory-guided hard constraint projection (HCP): A knowledge-based data-driven scientific machine learning method

delete2021-11-01
delete87
delete
OA
AI
Y
Yuntian Chen
D
Dou Huang
张东晓 cover
张东晓 (Dongxiao Zhang) *
J
Junsheng Zeng
N
Nanzhe Wang
H
Haoran Zhang
J
Jinyue Yan
DOI:10.1016/j.jcp.2021.110624delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Machine learning models have been successfully used in many scientific and engineering fields. However, it remains difficult for a model to simultaneously utilize domain knowledge and experimental observation data. The application of knowledge-based symbolic artificial intelligence (AI) represented by expert systems is limited by the expressive ability of the model, and data-driven connectionism AI represented by neural networks is prone to produce predictions that might violate physical principles. In order to fully integrate domain knowledge with observations and make full use of the strong fitting ability of neural networks, this study proposes theory-guided hard constraint projection (HCP). This deep learning model converts physical constraints, such as governing equations, into a form that is easy to handle through discretization, and then implements hard constraint optimization through projection in a patch. Based on rigorous mathematical proofs, theory-guided HCP can ensure that model predictions strictly conform to physical mechanisms in the constraint patch. The training process of theory-guided HCP only needs a small amount of labeled data (sparse observation), and it can supervise the model by combining the coordinates (label-free data) with domain knowledge. The performance of the theory-guided HCP is verified by experiments based on a published heterogeneous subsurface flow problem. The experiments show that theory-guided HCP requires fewer data, and achieves higher prediction accuracy and stronger robustness to noisy observations, than the fully connected neural networks and soft constraint models. Furthermore, due to the application of domain knowledge, theory-guided HCP possesses the ability to extrapolate and can accurately predict points outside of the range of the training dataset. (C) 2021 The Author(s). Published by Elsevier Inc.
Keywords:
Hard constraint
Theory guided
Physics informed
Sparse observation
Projection
Constraint patch
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Journal of Computational Physics cover
Journal of Computational Physics
IF:
3.8
Papers:
1.5W
Citations:
7.4W

Organization

U
University of Tokyo
Scholars:
7.1W
Papers: 6.5W
Citations: 2.2K
M
Malardalen University
Scholars:
1.2K
Papers: 1.5K
Citations: 3
P
Peng Cheng Laboratory
Scholars:
1.7K
Papers: 1.8K
Citations: 2.0K
P
peking university
Scholars:
11.8W
Papers: 8.7W
Citations: 146
researcher View more organizations