.png){kind=icon}
返回
iPINNs: incremental learning for Physics-informed neural networks
.png){kind=icon}
PRE
AI
DOI：10.1007/s00366-024-02010-1.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Physics-informed neural networks (PINNs) have recently become a powerful tool for solving partial differential equations (PDEs). However, finding a set of neural network parameters that fulfill a PDE at the boundary and within the domain of interest can be challenging and non-unique due to the complexity of the loss landscape that needs to be traversed. Although a variety of multi-task learning and transfer learning approaches have been proposed to overcome these issues, no incremental training procedure has been proposed for PINNs. As demonstrated herein, by developing incremental PINNs (iPINNs) we can effectively mitigate such training challenges and learn multiple tasks (equations) sequentially without additional parameters for new tasks. Interestingly, we show that this also improves performance for every equation in the sequence. Our approach learns multiple PDEs starting from the simplest one by creating its own subnetwork for each PDE and allowing each subnetwork to overlap with previously learned subnetworks. We demonstrate that previous subnetworks are a good initialization for a new equation if PDEs share similarities. We also show that iPINNs achieve lower prediction error than regular PINNs for two different scenarios: (1) learning a family of equations (e.g., 1-D convection PDE); and (2) learning PDEs resulting from a combination of processes (e.g., 1-D reaction-diffusion PDE). The ability to learn all problems with a single network together with learning more complex PDEs with better generalization than regular PINNs will open new avenues in this field.
Keyword:
Physic-informed neural networks (PINNs)
Scientific machine learning (SciML)
Incremental learning
Sparsity
期刊
IF:
4.9
论文数:
2.6K
被引数:
9.3K
机构
引用论文
Desempenho de crianças do ensino fundamental na solução de problemas aritméticos<A NAME="top"></A>问题的基本解决方案 
OAAI
OAAI分享收藏Physics-informed neural network for modelling the thermochemical curing process of composite-tool systems during manufacture用于在制造过程中对复合工具系统的热化学固化过程进行建模的物理通知神经网络
OAAI
OAAI分享收藏Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations物理信息神经网络: 一种用于解决涉及非线性偏微分方程的正反问题的深度学习框架OAAI
OAAI分享收藏分享收藏Physics-informed neural networks for inverse problems in nano-optics and metamaterials用于纳米光学和超材料中反问题的物理通知神经网络.png)
OPTICS EXPRESSOAAI
OPTICS EXPRESSIF3.3
OAAI分享收藏Deep learning in nano-photonics: inverse design and beyond纳米光子学中的深度学习: 逆向设计及超越PHOTONICS RESEARCHOAAI
PHOTONICS RESEARCHIF7.2
OAAI分享收藏分享收藏
查看更多内容