arrow
返回

Statistical guarantees for regularized neural networks

delete2021-10-01
delete13
delete
OA
AI
M
Mahsa Taheri
F
Fang Xie *
J
Johannes Lederer
DOI:10.1016/j.neunet.2021.04.034delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Neural networks have become standard tools in the analysis of data, but they lack comprehensive mathematical theories. For example, there are very few statistical guarantees for learning neural networks from data, especially for classes of estimators that are used in practice or at least similar to such. In this paper, we develop a general statistical guarantee for estimators that consist of a least-squares term and a regularizer. We then exemplify this guarantee with l(1)-regularization, showing that the corresponding prediction error increases at most logarithmically in the total number of parameters and can even decrease in the number of layers. Our results establish a mathematical basis for regularized estimation of neural networks, and they deepen our mathematical understanding of neural networks and deep learning more generally. (C) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Neural networks
Deep learning
Prediction guarantees
Regularization
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
8.2K
被引数:
3.0W

机构

R
ruhr university bochum
学者数:
2.3W
论文数: 1.9W
被引数: 14
引用论文

引用论文

Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
err分享
err收藏
Photoelectrochemical Study of Nitrogen-Doped Titanium Dioxide for Water Oxidation
err2004-04-20
err0
PREAI
errGemma Romualdo Torres; Torbjörn Lindgren; Jun Lu; Claes-Göran Granqvist; Sten-Eric Lindquist
err分享
err收藏
err分享
err收藏
Group sparse regularization for deep neural networks
err2017-06-01
err341
errOAAI
errScardapane, Simone; Comminiello, Danilo; Hussain, Amir; Uncini, Aurelio
err分享
err收藏
First principles study of anti-ReO3 type Cu3N and Sc-doped Cu3N on structural, elastic and electronic properties
err2013-08-01
err0
PREAI
errHuangyu Chen; Xing’ao Li; Jinyang Zhao; Zhenli Wu; Tao Yang; Yanwen Ma; Wei Huang; Kailun Yao
err分享
err收藏
学者 查看更多内容