arrow
返回

A new reverse reduce-error ensemble pruning algorithm

delete2015-03-01
delete38
PRE
AI
戴群 (Qun Dai) *
张挺 封面图
张挺 (Ting Zhang)
DOI:10.1016/j.asoc.2014.10.045delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Although greedy algorithms possess high efficiency, they often receive suboptimal solutions of the ensemble pruning problem, since their exploration areas are limited in large extent. And another marked defect of almost all the currently existing ensemble pruning algorithms, including greedy ones, consists in: they simply abandon all of the classifiers which fail in the competition of ensemble selection, causing a considerable waste of useful resources and information. Inspired by these observations, an interesting greedy Reverse Reduce-Error (RRE) pruning algorithm incorporated with the operation of subtraction is proposed in this work. The RRE algorithm makes the best of the defeated candidate networks in a way that, the Worst Single Model (WSM) is chosen, and then, its votes are subtracted from the votes made by those selected components within the pruned ensemble. The reason is because, for most cases, the WSM might make mistakes in its estimation for the test samples. And, different from the classical RE, the near-optimal solution is produced based on the pruned error of all the available sequential subensembles. Besides, the backfitting step of RE algorithm is replaced with the selection step of a WSM in RRE. Moreover, the problem of ties might be solved more naturally with RRE. Finally, soft voting approach is employed in the testing to RRE algorithm. The performances of RE and RRE algorithms, and two baseline methods, i.e., the method which selects the Best Single Model (BSM) in the initial ensemble, and the method which retains all member networks of the initial ensemble (ALL), are evaluated on seven benchmark classification tasks under different initial ensemble setups. The results of the empirical investigation show the superiority of RRE over the other three ensemble pruning algorithms. (C) 2014 Elsevier B.V. All rights reserved.
Keyword:
Neural network ensemble
Machine learning
Pattern recognition
Classifier
Reduce-Error (RE) pruning
Reverse Reduce-Error (RRE) pruning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Applied Soft Computing 封面图
Applied Soft Computing
IF:
6.6
论文数:
1.4W
被引数:
4.8W

机构

暂无机构信息
引用论文

引用论文

Pruning an ensemble of classifiers via reinforcement learning
err2009-03-01
err77
PREAI
errPartalas, Ioannis; Tsoumakas, Grigorios; Vlahavas, Ioannis
err分享
err收藏
err分享
err收藏
Evaluation of post-stroke functionality based on the International Classification of Functioning, Disability, and Health: a proposal for use of assessment tools
err2015-01-01
err0
errOAAI
errSoraia Micaela Silva; Fernanda Ishida Corrêa; Christina Danielli Coelho de Morais Faria; Cássia Maria Buchalla; Paula Fernanda da Costa Silva; João Carlos Ferrari Corrêa
err分享
err收藏
err分享
err收藏
学者 查看更多内容