.png){kind=icon}
Return
A Decision Tree Classification Algorithm Based on Two-Term RS-Entropy
.png){kind=icon}
OA
AI
DOI：10.3390/e27101069.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Classification is an important task in the field of machine learning. Decision tree algorithms are a popular choice for handling classification tasks due to their high accuracy, simple algorithmic process, and good interpretability. Traditional decision tree algorithms, such as ID3, C4.5, and CART, differ primarily in their criteria for splitting trees. Shannon entropy, Gini index, and mean squared error are all examples of measures that can be used as splitting criteria. However, their performance varies on different datasets, making it difficult to determine the optimal splitting criterion. As a result, the algorithms lack flexibility. In this paper, we introduce the concept of generalized entropy from information theory, which unifies many splitting criteria under one free parameter, as the split criterion for decision trees. We propose a new decision tree algorithm called RSE (RS-Entropy decision tree). Additionally, we improve upon a two-term information measure method by incorporating penalty terms and coefficients into the split criterion, leading to a new decision tree algorithm called RSEIM (RS-Entropy Information Method). In theory, the improved algorithms RSE and RSEIM are more flexible due to the presence of multiple free parameters. In experiments conducted on several datasets, using genetic algorithms to optimize the parameters, our proposed RSE and RSEIM methods significantly outperform traditional decision tree methods in terms of classification accuracy without increasing the complexity of the resulting trees.
Keywords:
classification
decision tree
generalized entropy
split criteria
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
2
Papers:
956
Citations:
2.4W
Organization
Cited Papers
ShareSavePublic transport user's perception and decision assessment using tactic-based guidelines.png)
TRANSPORT POLICY
TRANSPORT POLICYIF5.3
PREAI
ShareSaveShareSaveMachine learning identifies experimental brain metastasis subtypes based on their influence on neural circuitsCancer CellOAAI
Cancer CellIF0
OAAIShareSaveShareSaveShareSaveShareSaveShareSave
View more