.png){kind=icon}
返回
Weight initialization algorithm for physics-informed neural networks using finite differences
.png){kind=icon}
PRE
AI
DOI：10.1007/s00366-023-01883-y.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
With physics-infor med neural networks (PINNs), inverse problems involving differential equations can be solved despite noise, sparsity, and varying levels of fidelity. The objective of PINNs is to minimize a loss function using all available information, including physical laws, initial conditions, boundary conditions, and observed quantities. This is accomplished by turning the original problem into a problem of optimization based on the available data. Our paper presents a method for initializing weights in PINNs using finite differences. We consider two neural networks, feed-forward neural network (FNN) u(1) and PINN u(2) with the same architecture. First, we construct a dataset and fit FNN u(1) to it. To generate our dataset, we use an approximate solution of the partial differential equation using finite differences. In our PINN, the initial weights are determined by the weights obtained from fitting FNN u(1 )to the constructed dataset. The use of coarse mesh resolutions has proven to be viable as well. In contrast to the vanilla PINN training strategy, the proposed weight initialization strategy reduces PINN solution errors and training loss. We also propose a method named Progressive Unfreezing (PU) to reduce the computational cost of training our model. PU gradually fine-tunes the layers of the PINN u(2) while keeping already fine-tuned layers frozen. This allows the model to leverage pre-trained knowledge and adapt to new task-specific data while reducing computational cost. We solve the one-dimensional diffusion (heat) equation, Fisher equation also known as the Kolmogo-rov-Petrovsky-Piscounov, and Burgers non-linear partial differential equation.
Keyword:
Finite difference
Deep learning
Physics-informed neural networks
Neural network weights
Scientific machine learning
期刊
IF:
4.9
论文数:
2.6K
被引数:
9.3K
机构
暂无机构信息
引用论文
Real-time and offline techniques for identifying obstructive sleep apnea patients用于识别阻塞性睡眠呼吸暂停患者的实时和离线技术
.png){kind=icon}
PREAI
分享收藏Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations物理信息神经网络: 一种用于解决涉及非线性偏微分方程的正反问题的深度学习框架
OAAI
OAAI分享收藏Supramolecular Approaches for Taming the Chemo- and Regiochemistry of C60 Addition Reactions驯服C60加成反应的化学和区域化学的超分子方法OAAI
OAAI分享收藏Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation通过boltzmann-bgk公式解决正向和反向流动问题的物理通知神经网络OAAI
OAAI分享收藏
查看更多内容