arrow
Return

A Survey on Graphical Methods for Classification Predictive Performance Evaluation

delete2011-11-01
delete75
PRE
AI
R
Ronaldo C. Prati *
G
Gustavo Batista
M
Maria Carolina Monard
DOI:10.1109/TKDE.2011.59delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Predictive performance evaluation is a fundamental issue in design, development, and deployment of classification systems. As predictive performance evaluation is a multidimensional problem, single scalar summaries such as error rate, although quite convenient due to its simplicity, can seldom evaluate all the aspects that a complete and reliable evaluation must consider. Due to this, various graphical performance evaluation methods are increasingly drawing the attention of machine learning, data mining, and pattern recognition communities. The main advantage of these types of methods resides in their ability to depict the trade-offs between evaluation aspects in a multidimensional space rather than reducing these aspects to an arbitrarily chosen (and often biased) single scalar measure. Furthermore, to appropriately select a suitable graphical method for a given task, it is crucial to identify its strengths and weaknesses. This paper surveys various graphical methods often used for predictive performance evaluation. By presenting these methods in the same framework, we hope this paper may shed some light on deciding which methods are more suitable to use in different situations.
Keywords:
Machine learning
data mining
performance evaluation
ROC curves
cost curves
lift graphs
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.7K
Citations:
3.2W

Organization

U
universidade federal do abc (ufabc)
Scholars:
3.5K
Papers: 3.3K
Citations: 1
U
universidade de sao paulo
Scholars:
10.5W
Papers: 6.7W
Citations: 93