arrow
返回

Approximation and learning by greedy algorithms

delete2008-02-01
delete214
delete
OA
AI
A
Andrew R. Barron *
A
Albert Cohen
W
Wolfgang Dahmen
R
Ronald DeVore
DOI:10.1214/009053607000000631delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We consider the problem of approximating a given element f from a Hilbert space H by means of greedy algorithms and the application of such procedures to the regression problem in statistical learning theory. We improve on the existing theory of convergence rates for both the orthogonal greedy algorithm and the relaxed greedy algorithm, as well as for the forward stepwise projection algorithm. For all these algorithms, we prove convergence results for a variety of function classes and not simply those that are related to the convex hull of the dictionary. We then show how these bounds for convergence rates lead to a new theory for the performance of greedy algorithms in learning. In particular, we build upon the results in [IEEE Trans. Inform. Theory 42 (1996) 2118-2132] to construct learning algorithms based on greedy approximations which are universally consistent and provide provable convergence rates for large classes of functions. The use of greedy algorithms in the context of learning is very appealing since it greatly reduces the computational burden when compared with standard model selection using general dictionaries.
Keyword:
nonparametric regression
statistical learning
convergence rates for greedy algorithms
interpolation spaces
neural networks
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Annals of Statistics 封面图
Annals of Statistics
IF:
3.7
论文数:
2.8K
被引数:
2.9W

机构

R
RWTH Aachen University
学者数:
3.5W
论文数: 2.6W
被引数: 3.6W
Y
Yale University
学者数:
6.5W
论文数: 6.0W
被引数: 10.0W
U
Universite Paris Cite
学者数:
8.9W
论文数: 6.3W
被引数: 604
S
Sorbonne Universite
学者数:
6.2W
论文数: 4.5W
被引数: 605
学者 查看更多机构
引用论文

引用论文

Least angle regression
err2004-04-01
err7.5K
errOAAI
errEfron, B; Hastie, T; Johnstone, I; Tibshirani, R
err分享
err收藏
err分享
err收藏
Real-Time Analysis of a Modified State Observer for Sensorless Induction Motor Drive Used in Electric Vehicle Applications
err2017-07-25
err0
errOAAI
errMohan Krishna S.; Febin Daya J.L.; Sanjeevikumar Padmanaban; Lucian Mihet-Popa
err分享
err收藏
VGF Changes during the Estrous Cycle: A Novel Endocrine Role for TLQP Peptides?
err2014-10-03
err0
errOAAI
errBarbara Noli; Carla Brancia; Filomena D’Amato; Gian-Luca Ferri; Cristina Cocco
err分享
err收藏
Prevalence of multimorbidity in community settings: A systematic review and meta-analysis of observational studies
err2019-08-22
err0
errOAAI
errHai Nguyen; Gergana Manolova; Christina Daskalopoulou; Silia Vitoratou; Martin Prince; A Matthew Prina
err分享
err收藏
学者 查看更多内容