arrow
Return

Learning and approximation capabilities of orthogonal super greedy algorithm

delete2016-03-01
delete11
PRE
AI
J
Jian Fang
S
Shao-Bo Lin *
Z
Zongben Xu
DOI:10.1016/j.knosys.2015.12.011delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We consider the approximation capability of orthogonal super greedy algorithms (OSGA) and its applications in supervised learning. OSGA focuses on selecting more than one atoms in each iteration, which, of course, reduces the computational burden when compared with the conventional orthogonal greedy algorithm (OGA). We prove that even for function classes that are not the convex hull of the dictionary, OSGA does not degrade the approximation capability of OGA, provided the dictionary is incoherent. Based on this, we deduce tight generalization error bounds for OSGA learning. Our results show that in the realm of supervised learning, OSGA provides a possibility to further reduce the computational burden of OGA on the premise of maintaining its prominent generalization capability. (C) 2015 Elsevier B.V. All rights reserved.
Keywords:
Supervised learning
Nonlinear approximation
Orthogonal super greedy algorithm
Orthogonal greedy algorithm
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

X
xi'an jiaotong university
Scholars:
9.2W
Papers: 6.6W
Citations: 75
W
Wenzhou University
Scholars:
8.8K
Papers: 6.5K
Citations: 1.5W