arrow
返回

Information theoretic perspective on sample complexity

delete2023-10-01
delete3
PRE
AI
D
Deborah Pereg *
DOI:10.1016/j.neunet.2023.08.032delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The statistical supervised learning framework assumes an input-output set with a joint probability distribution that is reliably represented by the training dataset. The learning system is then required to output a prediction rule learned from the training dataset's input-output pairs. In this work, we investigate the relationship between the sample complexity, the empirical risk and the generalization error based on the asymptotic equipartition property (AEP) (Shannon, 1948). We provide theoretical guarantees for reliable learning under the information-theoretic AEP, with respect to the generalization error and the sample size in different settings.(c) 2023 Elsevier Ltd. All rights reserved.
Keyword:
Information theory
Supervised learning
Sample complexity
Generalization

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
7.9K
被引数:
3.0W

机构

H
Harvard University
学者数:
26.5W
论文数: 22.0W
被引数: 28.7W
引用论文

引用论文

err分享
err收藏
Opening and closing of single-wall carbon nanotubes
err2004-11-01
err0
PREAI
errH.Z. Geng; X.B. Zhang; S.H. Mao; A. Kleinhammes; H. Shimoda; Y. Wu; O. Zhou
err分享
err收藏
Fields of Experts
err2009-01-24
err661
PREAI
errRoth, Stefan; Black, Michael J.
err分享
err收藏
Understanding Deep Learning (Still) Requires Rethinking Generalization理解深度学习 (仍然) 需要重新思考泛化
err2021-02-22
err1.2K
errOAAI
errZhang, Chiyuan; Bengio, Samy; Hardt, Moritz; Recht, Benjamin; Vinyals, Oriol
err分享
err收藏
The complete genome sequence of the Gram-positive bacterium Bacillus subtilis革兰氏阳性细菌枯草芽孢杆菌的全基因组序列
err1997-11-01
err0
errOAAI
errF. Kunst; N. Ogasawara; I. Moszer; A. M. Albertini; G. Alloni; V. Azevedo; M. G. Bertero; P. Bessières; A. Bolotin; S. Borchert; R. Borriss; L. Boursier; A. Brans; M. Braun; S. C. Brignell; S. Bron; S. Brouillet; C. V. Bruschi; B. Caldwell; V. Capuano; N. M. Carter; S.-K. Choi; J.-J. Codani; I. F. Connerton; N. J. Cummings; R. A. Daniel; F. Denizot; K. M. Devine; A. Düsterhöft; S. D. Ehrlich; P. T. Emmerson; K. D. Entian; J. Errington; C. Fabret; E. Ferrari; D. Foulger; C. Fritz; M. Fujita; Y. Fujita; S. Fuma; A. Galizzi; N. Galleron; S.-Y. Ghim; P. Glaser; A. Goffeau; E. J. Golightly; G. Grandi; G. Guiseppi; B. J. Guy; K. Haga; J. Haiech; C. R. Harwood; A. Hénaut; H. Hilbert; S. Holsappel; S. Hosono; M.-F. Hullo; M. Itaya; L. Jones; B. Joris; D. Karamata; Y. Kasahara; M. Klaerr-Blanchard; C. Klein; Y. Kobayashi; P. Koetter; G. Koningstein; S. Krogh; M. Kumano; K. Kurita; A. Lapidus; S. Lardinois; J. Lauber; V. Lazarevic; S.-M. Lee; A. Levine; H. Liu; S. Masuda; C. Mauël; C. Médigue; N. Medina; R. P. Mellado; M. Mizuno; D. Moestl; S. Nakai; M. Noback; D. Noone; M. O'Reilly; K. Ogawa; A. Ogiwara; B. Oudega; S.-H. Park; V. Parro; T. M. Pohl; D. Portetelle; S. Porwollik; A. M. Prescott; E. Presecan; P. Pujic; B. Purnelle; G. Rapoport; M. Rey; S. Reynolds; M. Rieger; C. Rivolta; E. Rocha; B. Roche; M. Rose; Y. Sadaie; T. Sato; E. Scanlan; S. Schleich; R. Schroeter; F. Scoffone; J. Sekiguchi; A. Sekowska; S. J. Seror; P. Serror; B.-S. Shin; B. Soldo; A. Sorokin; E. Tacconi; T. Takagi; H. Takahashi; K. Takemaru; M. Takeuchi; A. Tamakoshi; T. Tanaka; P. Terpstra; A. Tognoni; V. Tosato; S. Uchiyama; M. Vandenbol; F. Vannier; A. Vassarotti; A. Viari; R. Wambutt; E. Wedler; H. Wedler; T. Weitzenegger; P. Winters; A. Wipat; H. Yamamoto; K. Yamane; K. Yasumoto; K. Yata; K. Yoshida; H.-F. Yoshikawa; E. Zumstein; H. Yoshikawa; A. Danchin
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
没有更多内容