arrow
返回

SelectNet: Self-paced learning for high-dimensional partial differential equations

delete2021-09-01
delete35
delete
OA
AI
Y
Yiqi Gu
H
Haizhao Yang *
C
Chao Zhou
DOI:10.1016/j.jcp.2021.110444delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
The least squares method with deep neural networks as function parametrization has been applied to solve certain high-dimensional partial differential equations (PDEs) successfully; however, its convergence is slow and might not be guaranteed even within a simple class of PDEs. To improve the convergence of the network-based least squares model, we introduce a novel self-paced learning framework, SelectNet, which quantifies the difficulty of training samples, treats samples equally in the early stage of training, and slowly explores more challenging samples, e.g., samples with larger residual errors, mimicking the human cognitive process for more efficient learning. In particular, a selection network and the PDE solution network are trained simultaneously; the selection network adaptively weighting the training samples of the solution network achieving the goal of self-paced learning. Numerical examples indicate that the proposed SelectNet model outperforms existing models on the convergence speed and the convergence robustness, especially for low-regularity solutions. (c) 2021 Elsevier Inc. All rights reserved.
Keyword:
High-dimensional PDEs
Deep neural networks
Self-paced learning
Selected sampling
Least square method
Convergence
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Computational Physics 封面图
Journal of Computational Physics
IF:
3.8
论文数:
1.6W
被引数:
7.4W

机构

Purdue University System 封面图
Purdue University System
学者数:
4.0W
论文数: 3.6W
被引数: 66
P
Purdue University
学者数:
2.7W
论文数: 2.1W
被引数: 147
N
National University of Singapore
学者数:
7.6W
论文数: 6.5W
被引数: 11.4W
学者 查看更多机构
引用论文

引用论文

Neural network approximation: Three hidden layers are enough
err2021-09-01
err66
errOAAI
errShen, Zuowei; Yang, Haizhao; Zhang, Shijun
err分享
err收藏
D3M: A Deep Domain Decomposition Method for Partial Differential Equations
err2020-01-01
err84
errOAAI
errLi, Ke; Tang, Kejun; Wu, Tianfan; Liao, Qifeng
err分享
err收藏
Crack-healing in reaction-bonded silicon carbide
err2004-03-01
err0
PREAI
errMin-Cheol Chu; Seong-Jai Cho; Hyun-Min Park; Kyung-Jin Yoon; Hyun Ryu
err分享
err收藏
160 Gbit/s DPSK transmission over 320 km fibre link with high long-term stability
err2005-02-17
err0
PREAI
errS. Ferber; R. Ludwig; C. Boerner; C. Schubert; C. Schmidt-Langhorst; M. Kroh; V. Marembert; H.G. Weber
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
学者 查看更多内容