Weighted classifier ensemble based on quadratic form

doi:10.1016/j.patcog.2014.10.017

Weighted classifier ensemble based on quadratic form

2015-05-01

41

PRE

AI

DOI：10.1016/j.patcog.2014.10.017

Original

Original request for help

Save

Abstract

En 中文

Diversity and accuracy are the two key factors that decide the ensemble generalization error. Constructing a good ensemble method by balancing these two factors is difficult, because increasing diversity is at the cost of reducing accuracy normally. In order to improve the performance of an ensemble while avoiding the difficulty derived of balancing diversity and accuracy, we propose a novel method that weights each classifier in the ensemble by maximizing three different quadratic forms. In this paper, the optimal weight of individual classifiers is obtained by minimizing the ensemble error, rather than analyzing diversity and accuracy. Since it is difficult to minimize the general form of the ensemble error directly, we approximate the error in an objective function subject to two constraints (Sigma w(i) = 1 and -1 < w(i) < 1). Particularly, we introduce an error term with a weight vector w(o), and subtract this error with the quadratic form to obtain our approximated error. This subtraction makes minimizing the approximation form equivalent to maximizing the original quadratic form. Theoretical analysis finds that when the value of the quadratic form is maximized, the error of an ensemble system with the corresponding optimal weight w* will be smallest, especially compared with the ensemble with wo. Finally, we demonstrate improved classification performance from the experimental results of an artificial dataset, UCI datasets and PoISAR image data. (C) 2014 Elsevier Ltd. All rights reserved.

Keywords:

Ensemble learning

Weighted classifier ensemble

Quadratic form

Weighted classifier ensemble based on quadratic form

Abstract

AI Summary

Journal

Organization