arrow
Return

Fully corrective boosting with arbitrary loss and regularization

delete2013-12-01
delete7
delete
OA
AI
C
Chunhua Shen *
H
Hanxi Li
A
Anton van den Hengel
DOI:10.1016/j.neunet.2013.07.006delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We propose a general framework for analyzing and developing fully corrective boosting-based classifiers. The framework accepts any convex objective function, and allows any convex (for example, l(p)-norm, p >= 1) regularization term. By placing the wide variety of existing fully corrective boosting-based classifiers on a common footing, and considering the primal and dual problems together, the framework allows a direct comparison between apparently disparate methods. By solving the primal rather than the dual the framework is capable of generating efficient fully-corrective boosting algorithms without recourse to sophisticated convex optimization processes. We show that a range of additional boosting-based algorithms can be incorporated into the framework despite not being fully corrective. Finally, we provide an empirical analysis of the performance of a variety of the most significant boosting-based classifiers on a few machine learning benchmark datasets. (C) 2013 Elsevier Ltd. All rights reserved.
Keywords:
Boosting
Ensemble learning
Convex optimization
Column generation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
7.8K
Citations:
3.0W

Organization

U
University of Adelaide
Scholars:
2.3W
Papers: 2.4W
Citations: 4.2W
A
Australian National University
Scholars:
2.1W
Papers: 2.3W
Citations: 3.9W