arrow
Return

Decision Tree Algorithm Considering Distances Between Classes

delete2022-01-01
delete14
delete
OA
AI
S
Sang‐Yong Tom Lee
C
Chulhee Lee
K
Kwon Gi Mun
D
Dohyun Kim *
DOI:10.1109/ACCESS.2022.3187172delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Decision tree algorithm (DT) is a commonly used data mining method for classification and regression. DT repeatedly divides a dataset into pure subsets based on impurity measurements such as entropy and Gini. Then relatively pure partitions consisting of observations with the (almost) same class are obtained. Gini index is one of the representative indices for measuring the impurity of data. However, the Gini index does not take into account distances between classes. If the distances between classes are considered when measuring impurity, the decision tree algorithm can distinguish clearly observations with different classes. To the end, a new decision tree algorithm based on Rao-Stirling index is proposed considering distances between classes. Rao-Stirling index considers distances between classes in such a way that weights more to pairs of references in more distant classes when measuring data impurity. Experimental results indicate that the proposed method is superior in terms of accuracy, implying that considering the distances between classes can help improve accuracy in DT.
Keywords:
Impurities
Indexes
Decision trees
Random forests
Partitioning algorithms
Entropy
Gain measurement
Decision tree
distance between classes
Rao-Stirling index

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

California State University System cover
California State University System
Scholars:
2.8W
Papers: 2.4W
Citations: 457
M
Myongji University
Scholars:
2.1K
Papers: 2.0K
Citations: 4