返回
Unifying multi-class AdaBoost algorithms with binary base learners under the margin framework
DOI:10.1016/j.patrec.2006.11.001.png)
摘要
En 中文
Multi-class AdaBoost algorithms AdaBooost.MO, -ECC and -OC have received a great attention in the literature, but their relationships have not been fully examined to date. In this paper, we present a novel interpretation of the three algorithms, by showing that MO and ECC perform stage-wise functional gradient descent on a cost function defined over margin values, and that OC is a shrinkage version of ECC. This allows us to strictly explain the properties of ECC and OC, empirically observed in prior work. Also, the outlined interpretation leads us to introduce shrinkage as regularization in MO and ECC, and thus to derive two new algorithms: SMO and SECC. Experiments on diverse databases are performed. The results demonstrate the effectiveness of the proposed algorithms and validate our theoretical findings. (c) 2006 Elsevier B.V. All rights reserved.
Keyword:
AdaBoost
margin theory
multi-class classification problem
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.3
论文数:
8.0K
被引数:
1.6W
机构
暂无机构信息
引用论文
An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization
MACHINE LEARNING
IF2.9
Viscosity of (C2–C14) 1-alkyl-3-methylimidazolium bis(trifluoromethylsulfonyl)amide ionic liquids in an extended temperature range(C2-C14) 1-烷基-3-甲基咪唑双 (三氟甲基磺酰基) 酰胺离子液体在扩展温度范围内的粘度
A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting在线学习的决策理论概括及其在Boosting中的应用
没有更多内容

