arrow
Return

DES-AS: Dynamic ensemble selection based on algorithm Shapley

delete2025-01-01
delete0
PRE
AI
Z
Zhong-Liang Zhang
X
Xinggang Luo
DOI:10.1016/j.patcog.2024.110899delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Dynamic ensemble selection (DES) effectively improves aggregation performance by dynamically finding the most appropriate subset of classifiers for each query sample. The key component of this strategy is to define an appropriate criterion for evaluating the competence of the candidate classifiers. In this study, we present a new group-based criterion, synergy competence, to comprehensively measure the magnitude of the intricate synergy effect among classifiers. In addition, we introduce the algorithm Shapley, a variant of the Shapley value (SV) in the game theory, to measure the synergy competence of each classifier, which helps in the construction of a synergy-based DES system, called DES-AS. We argue that candidate classifiers with positive algorithm Shapley should be selected as they contribute to the ensemble. After selecting a subset of classifiers, the normalized algorithm Shapley is employed to calculate the voting weights for a cooperative final classification decision. The experimental analyses conducted on forty real-world datasets not only indicate that the synergy competence estimated by the algorithm Shapley is more applicable than classic group-based metrics, but also show that DES-AS is substantially more effective and robust than state-of-the-art models. The statistical test results also indicate that the estimated synergy competence reflects the real competence of each classifier better than the baseline models.
Keywords:
Dynamic ensemble selection
Classifier competence
Shapley value
Monte Carlo simulation
Dynamic weighting

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

H
Hangzhou Dianzi University
Scholars:
1.3W
Papers: 9.6K
Citations: 7.5K