arrow
返回

Analysis of boosting algorithms using the smooth margin function

delete2007-12-01
delete19
delete
OA
AI
C
Cynthia Rudin *
R
Robert E. Schapire
I
Ingrid Daubechies
DOI:10.1214/009053607000000785delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We introduce a useful tool for analyzing boosting algorithms called the smooth margin function, a differentiable approximation of the usual margin for boosting algorithms. We present two boosting algorithms based on this smooth margin, coordinate ascent boosting and approximate coordinate ascent boosting, which are similar to Freund and Schapire's AdaBoost algorithm and Breiman's arc-gv algorithm. We give convergence rates to the maximum margin solution for both of our algorithms and for arc-gv. We then study AdaBoost's convergence properties using the smooth margin function. We precisely bound the margin attained by AdaBoost when the edges of the weak classifiers fall within a specified range. This shows that a previous bound proved by Ratsch and Warmuth is exactly tight. Furthermore, we use the smooth margin to capture explicit properties of AdaBoost in cases where cyclic behavior occurs.
Keyword:
boosting
AdaBoost
large margin classification
coordinate descent
arc-gv
convergence rates
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Annals of Statistics 封面图
Annals of Statistics
IF:
3.7
论文数:
2.8K
被引数:
2.9W

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
P
Princeton University
学者数:
2.1W
论文数: 2.3W
被引数: 5.1W
引用论文

引用论文

err分享
err收藏
Identification of thaumatin‐like protein and aspartyl protease as new major allergens in lettuce (Lactuca sativa)
err2013-08-25
err0
PREAI
errEsther Muñoz‐García; Olga Luengo‐Sánchez; Elisa Haroun‐Díaz; Aroa Sanz Maroto; Arancha Palacín; Araceli Díaz –Perales; Manuel de las Heras Gozalo; Moisés Labrador‐Horrillo; Fernando Vivanco; Javier Cuesta‐Herranz; Carlos Pastor‐Vargas
err分享
err收藏
Logistic regression, AdaBoost and Bregman distances
err2002-01-01
err426
errOAAI
errCollins, M; Schapire, RE; Singer, Y
err分享
err收藏
Update on the Treatment of Metastatic Urothelial Carcinoma
err2018-06-06
err0
errOAAI
errNedal Bukhari; Humaid O. Al-Shamsi; Faisal Azam
err分享
err收藏
The Optimized Link State Routing Protocol Version 2
err
IF0
err2014-04-01
err0
errOAAI
errT. Clausen; C. Dearlove; P. Jacquet; U. Herberg
err分享
err收藏
Large Dynamic Direct Shear Machine for Geosynthetic Clay Liners
err2006-09-01
err0
PREAI
errPJ Fox; CJ Nye; TC Morrison; JG Hunter; JT Olsta
err分享
err收藏
On the presence and functional significance of sympathetic premotor neurons with collateralized spinal axons in the rat
err2019-06-02
err0
errOAAI
errDavid G. S. Farmer; Natasha Pracejus; Bowen Dempsey; Anita Turner; Phillip Bokiniec; Julian F. R. Paton; Anthony E. Pickering; Jasmine Burguet; Philippe Andrey; Ann K. Goodchild; Robin M. McAllen; Simon McMullan
err分享
err收藏
学者 查看更多内容