arrow
Return

A non-specialized ensemble classifier using multi-objective optimization

delete2020-10-01
delete12
PRE
AI
S
Sam Fletcher *
B
Brijesh Verma
Z
Zhang, Mengjie
DOI:10.1016/j.neucom.2020.05.029delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Ensemble classification algorithms are often designed for data with certain properties, such as imbalanced class labels, a large number of attributes, or continuous data. While high-performing, these algorithms sacrifice performance when applied to data outside the targeted domain. We propose a non-specific ensemble classification algorithm that uses multi-objective optimization instead of relying on heuristics and fragile user-defined parameters. Only two user-defined parameters are included, with both being found to have large windows of values that produce statistically indistinguishable results, indicating the low level of expertise required from the user to achieve good results. Additionally, when given a large initial set of trained base-classifiers, we demonstrate that a multi-objective genetic algorithm aiming to optimize prediction accuracy and diversity will prefer particular types of classifiers over others. The total number of chosen classifiers is also surprisingly small - only 10.14 classifiers on average, out of an initial pool of 900. This occurs without any explicit preference for small ensembles of classifiers. Even with these small ensembles, significantly lower empirical classification error is achieved compared to the current state-of-the-art. (C) 2020 Elsevier B.V. All rights reserved.
Keywords:
Ensemble classification
Multi-objective optimization
Genetic algorithm
Multiple classifiers
Classifier selection
Diversity
Double-fault measure
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

V
Victoria University Wellington
Scholars:
5.6K
Papers: 5.9K
Citations: 54
C
central queensland university
Scholars:
2.7K
Papers: 3.2K
Citations: 6