arrow
Return

Swarm-based Cost-sensitive Decision Tree Using Optimized Rules for Imbalanced Data Classification

delete2025-04-04
delete0
PRE
AI
M
Mehdi Mansouri
M
Mohammad H. Nadimi-Shahraki *
Z
Zahra Beheshti
DOI:10.1007/s42235-025-00673-0delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Despite the widespread use of Decision trees (DT) across various applications, their performance tends to suffer when dealing with imbalanced datasets, where the distribution of certain classes significantly outweighs others. Cost-sensitive learning is a strategy to solve this problem, and several cost-sensitive DT algorithms have been proposed to date. However, existing algorithms, which are heuristic, tried to greedily select either a better splitting point or feature node, leading to local optima for tree nodes and ignoring the cost of the whole tree. In addition, determination of the costs is difficult and often requires domain expertise. This study proposes a DT for imbalanced data, called Swarm-based Cost-sensitive DT (SCDT), using the cost-sensitive learning strategy and an enhanced swarm-based algorithm. The DT is encoded using a hybrid individual representation. A hybrid artificial bee colony approach is designed to optimize rules, considering specified costs in an F-Measure-based fitness function. Experimental results using datasets compared with state-of-the-art DT algorithms show that the SCDT method achieved the highest performance on most datasets. Moreover, SCDT also excels in other critical performance metrics, such as recall, precision, F1-score, and AUC, with notable results with average values of 83%, 87.3%, 85%, and 80.7%, respectively.
Keywords:
Decision tree
Cost-sensitive learning
Artificial bee colony
Swarm-based
Imbalanced classification

Journal

Journal of Bionic Engineering cover
Journal of Bionic Engineering
IF:
5.8
Papers:
1.9K
Citations:
4.8K

Organization

I
Islamic Azad University
Scholars:
4.0W
Papers: 3.3W
Citations: 9.8K