返回
摘要
En 中文
Boosting is an iterative process that improves the predictive accuracy for supervised (machine) learning algorithms. Boosting operates by learning multiple functions with subsequent functions focusing on incorrect instances where the previous functions predicted the wrong label. Despite considerable success, boosting still has difficulty on data sets with certain types of problematic training data (e.g., label noise) and when complex functions overfit the training data. We propose a novel cluster-based boosting (CBB) approach to address limitations in boosting for supervised learning systems. Our CBB approach partitions the training data into clusters containing highly similar member data and integrates these clusters directly into the boosting process. CBB boosts selectively (using a high learning rate, low learning rate, or not boosting) on each cluster based on both the additional structure provided by the cluster and previous function accuracy on the member data. Selective boosting allows CBB to improve predictive accuracy on problematic training data. In addition, boosting separately on clusters reduces function complexity to mitigate overfitting. We provide comprehensive experimental results on 20 UCI benchmark data sets with three different kinds of supervised learning systems. These results demonstrate the effectiveness of our CBB approach compared to a popular boosting algorithm, an algorithm that uses clusters to improve boosting, and two algorithms that use selective boosting without clustering.
Keyword:
Artificial intelligence
machine learning
clustering algorithms
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
引用论文
Purpura Fulminans and Symmetrical Peripheral Gangrene Caused by Capnocytophaga canimorsus (Formerly DF-2) Septicemia—A Complication of Dog Bite
Medicine
IF0
On the equivalence of weak learnability and linear separability: new relaxations and efficient boosting algorithms关于弱可学习性和线性可分性的等价性: 新的松弛和有效的提升算法
MACHINE LEARNING
IF2.9
Physiological and behavioral responses to corticotropin-releasing factor administration: is CRF a mediator of anxiety or stress responses?促肾上腺皮质激素释放因子的生理和行为反应: CRF是焦虑或应激反应的中介物吗?


