arrow
返回

Synergistic learning with multi-task DeepONet for efficient PDE problem solving

delete2025-04-01
delete0
PRE
AI
V
Varun Kumar
S
Somdatta Goswami *
K
Katiana Kontolati
M
Michael D. Shields
G
George Em Karniadakis
DOI:10.1016/j.neunet.2024.107113delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional machine learning to address issues such as data sparsity and overfitting in neural networks. In this work, we apply MTL to problems in science and engineering governed by partial differential equations (PDEs). However, implementing MTL in this context is complex, as it requires task- specific modifications to accommodate various scenarios representing different physical processes. To this end, we present a multi-task deep operator network (MT-DeepONet) to learn solutions across various functional forms of source terms in a PDE and multiple geometries in a single concurrent training session. We introduce modifications in the branch network of the vanilla DeepONet to account for various functional forms of a parameterized coefficient in a PDE. Additionally, we handle parameterized geometries by introducing a binary mask in the branch network and incorporating it into the loss term to improve convergence and generalization to new geometry tasks. Our approach is demonstrated on three benchmark problems: (1) learning different functional forms of the source term in the Fisher equation; (2) learning multiple geometries in a 2D Darcy Flow problem and showcasing better transfer learning capabilities to new geometries; and (3) learning 3D parameterized geometries fora heat transfer problem and demonstrate the ability to predict on new but similar geometries. Our MT-DeepONet framework offers a novel approach to solving PDE problems in engineering and science under a unified umbrella based on synergistic learning that reduces the overall training cost for neural operators.
Keyword:
Multi-task learning
Neural operators
DeepONet
Scientific machine learning

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

B
Brown University
学者数:
2.4W
论文数: 2.2W
被引数: 3.2W
J
Johns Hopkins University
学者数:
10.2W
论文数: 8.8W
被引数: 13.0W
引用论文

引用论文

err分享
err收藏
Neural operator learning of heterogeneous mechanobiological insults contributing to aortic aneurysms
err2022-08-31
err14
errOAAI
errGoswami, Somdatta; Li, David S. S.; Rego, Bruno V. V.; Latorre, Marcos; Humphrey, Jay D. D.; Karniadakis, George Em
err分享
err收藏
err分享
err收藏
A physics-informed variational DeepONet for predicting crack path
err2022-03-01
err150
errOAAI
errGoswami, Somdatta; Yin, Minglang; Yu, Yue; Karniadakis, George Em
err分享
err收藏
Evolution of Organic Aerosols in the Atmosphere
err2009-12-11
err0
PREAI
errJ. L. Jimenez; M. R. Canagaratna; N. M. Donahue; A. S. H. Prevot; Q. Zhang; J. H. Kroll; P. F. DeCarlo; J. D. Allan; H. Coe; N. L. Ng; A. C. Aiken; K. S. Docherty; I. M. Ulbrich; A. P. Grieshop; A. L. Robinson; J. Duplissy; J. D. Smith; K. R. Wilson; V. A. Lanz; C. Hueglin; Y. L. Sun; J. Tian; A. Laaksonen; T. Raatikainen; J. Rautiainen; P. Vaattovaara; M. Ehn; M. Kulmala; J. M. Tomlinson; D. R. Collins; M. J. Cubison; J. Dunlea; J. A. Huffman; T. B. Onasch; M. R. Alfarra; P. I. Williams; K. Bower; Y. Kondo; J. Schneider; F. Drewnick; S. Borrmann; S. Weimer; K. Demerjian; D. Salcedo; L. Cottrell; R. Griffin; A. Takami; T. Miyoshi; S. Hatakeyama; A. Shimono; J. Y Sun; Y. M. Zhang; K. Dzepina; J. R. Kimmel; D. Sueper; J. T. Jayne; S. C. Herndon; A. M. Trimborn; L. R. Williams; E. C. Wood; A. M. Middlebrook; C. E. Kolb; U. Baltensperger; D. R. Worsnop
err分享
err收藏
Deep neural operators can predict the real-time response of floating offshore structures under irregular waves
err2024-01-01
err12
errOAAI
errCao, Qianying; Goswami, Somdatta; Tripura, Tapas; Chakraborty, Souvik; Karniadakis, George Em
err分享
err收藏
学者 查看更多内容