arrow
返回

Simultaneous neural network approximation for smooth functions

delete2022-10-01
delete9
delete
OA
AI
S
Sean Hon *
H
Haizhao Yang
DOI:10.1016/j.neunet.2022.06.040delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We establish in this work approximation results of deep neural networks for smooth functions measured in Sobolev norms, motivated by recent development of numerical solvers for partial differential equations using deep neural networks. Our approximation results are nonasymptotic in the sense that the error bounds are explicitly characterized in terms of both the width and depth of the networks simultaneously with all involved constants explicitly determined. Namely, for f is an element of C-s ([0, 1](d)), we show that deep ReLU networks of width O(N log N) and of depth O(L log L) can achieve a nonasymptotic approximation rate of O(N-2(s-1)/d L-2(s-1)/d) with respect to the W-1,W-p([0, 1](d)) norm for p is an element of [1, infinity). If either the ReLU function or its square is applied as activation functions to construct deep neural networks of width O(N log N) and of depth O(L log L) to approximate f is an element of C-s ([0, 1](d)), the approximation rate is O((N-2(s-n)/dL-2(s-n)/d) with respect to the W-n,W-p([0, 1](d)) norm for p is an element of [1, infinity). (C) 2022 Elsevier Ltd. All rights reserved.
Keyword:
Deep neural networks
Sobolev norm
ReLUk activation functions
Approximation theory
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
7.8K
被引数:
3.0W

机构

H
Hong Kong Baptist University
学者数:
6.3K
论文数: 7.5K
被引数: 1.3W
Purdue University System 封面图
Purdue University System
学者数:
3.9W
论文数: 3.6W
被引数: 66
引用论文

引用论文

Neural network approximation: Three hidden layers are enough
err2021-09-01
err66
errOAAI
errShen, Zuowei; Yang, Haizhao; Zhang, Shijun
err分享
err收藏
Electrically-Driven Proton Transfer Promotes Brønsted Acid Catalysis by Orders of Magnitude
err
IF0
err2023-08-24
err0
errOAAI
errKarl Westendorff; Max Hülsey; Thejas Wesley; Yuriy Román-Leshkov; Yogesh Surendranath
err分享
err收藏
Accuracy of preoperative endorectal MRI in predicting extracapsular extension and influence on neurovascular bundle sparing in radical prostatectomy
err2012-01-17
err0
PREAI
errMatthias C. Roethke; Matthias P. Lichy; Michaela Kniess; Matthias K. Werner; Claus D. Claussen; Arnulf Stenzl; Heinz-Peter Schlemmer; David Schilling
err分享
err收藏
err分享
err收藏
Carbofuran degradation in soil profiles
err1997-11-01
err0
PREAI
errS. L. Trabue; X. Feng; A. V. Ogram; L. -T. Ou
err分享
err收藏
学者 查看更多内容