arrow
Return

A k-norm pruning algorithm for decision tree classifiers based on error rate estimation

delete2008-01-04
delete18
delete
OA
AI
钟鸣宇 (Mingyu Zhong)
M
Michael Georgiopoulos *
G
Georgios C. Anagnostopoulos
DOI:10.1007/s10994-007-5044-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Decision trees are well-known and established models for classification and regression. In this paper, we focus on the estimation and the minimization of the misclassification rate of decision tree classifiers. We apply Lidstone's Law of Succession for the estimation of the class probabilities and error rates. In our work, we take into account not only the expected values of the error rate, which has been the norm in existing research, but also the corresponding reliability (measured by standard deviations) of the error rate. Based on this estimation, we propose an efficient pruning algorithm, called k-norm pruning, that has a clear theoretical interpretation, is easily implemented, and does not require a validation set. Our experiments show that our proposed pruning algorithm produces accurate trees quickly, and compares very favorably with two other well-known pruning algorithms, CCP of CART and EBP of C4.5.
Keywords:
decision tree
pruning
law of succession

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

State University System of Florida cover
State University System of Florida
Scholars:
12.7W
Papers: 10.9W
Citations: 130
U
University of Central Florida
Scholars:
8.5K
Papers: 6.8K
Citations: 1.4W