arrow
Return

Swarm-based Cost-sensitive Decision Tree Using Optimized Rules for Imbalanced Data Classification

delete2025-04-04
delete0
PRE
AI
M
Mehdi Mansouri
M
Mohammad H. Nadimi-Shahraki *
Z
Zahra Beheshti
DOI:10.1007/s42235-025-00673-0delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Despite the widespread use of Decision trees (DT) across various applications, their performance tends to suffer when dealing with imbalanced datasets, where the distribution of certain classes significantly outweighs others. Cost-sensitive learning is a strategy to solve this problem, and several cost-sensitive DT algorithms have been proposed to date. However, existing algorithms, which are heuristic, tried to greedily select either a better splitting point or feature node, leading to local optima for tree nodes and ignoring the cost of the whole tree. In addition, determination of the costs is difficult and often requires domain expertise. This study proposes a DT for imbalanced data, called Swarm-based Cost-sensitive DT (SCDT), using the cost-sensitive learning strategy and an enhanced swarm-based algorithm. The DT is encoded using a hybrid individual representation. A hybrid artificial bee colony approach is designed to optimize rules, considering specified costs in an F-Measure-based fitness function. Experimental results using datasets compared with state-of-the-art DT algorithms show that the SCDT method achieved the highest performance on most datasets. Moreover, SCDT also excels in other critical performance metrics, such as recall, precision, F1-score, and AUC, with notable results with average values of 83%, 87.3%, 85%, and 80.7%, respectively.
Keywords:
Decision tree
Cost-sensitive learning
Artificial bee colony
Swarm-based
Imbalanced classification

Journal

Journal of Bionic Engineering cover
Journal of Bionic Engineering
IF:
5.8
Papers:
2.0K
Citations:
4.8K

Organization

I
Islamic Azad University
Scholars:
4.0W
Papers: 3.3W
Citations: 9.8K
Cited Papers

Cited Papers

Recent advances in decision trees: an updated survey
err2022-10-10
err127
PREAI
errCosta, Vinicius G.; Pedreira, Carlos E.
errShare
errSave
errShare
errSave
SCADA intrusion detection scheme exploiting the fusion of modified decision tree and Chi-square feature selection
err2023-04-01
err32
errOAAI
errAhakonye, Love Allen Chijioke; Nwakanma, Cosmas Ifeanyi; Lee, Jae-Min; Kim, Dong-Seong
errShare
errSave
Binary Decision Tree Using Genetic Algorithm for Recognizing Defect Patterns of Cold Mill Strip
err2004-01-01
err0
PREAI
errKyoung Min Kim; Joong Jo Park; Myung Hyun Song; In Cheol Kim; Ching Y. Suen
errShare
errSave
errShare
errSave
Sin-Cos-bIAVOA A new feature selection method based on improved African vulture optimization algorithm and a novel transfer function to DDoS attack detection
err2023-10-01
err14
PREAI
errSharifian, Zakieh; Barekatain, Behrang; Quintana, Alfonso Ariza; Beheshti, Zahra; Safi-Esfahani, Faramarz
errShare
errSave
errShare
errSave
researcher View more