.png){kind=icon}
Return
Using AUC and accuracy in evaluating learning algorithms
.png){kind=icon}
OA
AI
DOI：10.1109/TKDE.2005.50.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The area under the ROC ( Receiver Operating Characteristics) curve, or simply AUC, has been traditionally used in medical diagnosis since the 1970s. It has recently been proposed as an alternative single-number measure for evaluating the predictive ability of learning algorithms. However, no formal arguments were given as to why AUC should be preferred over accuracy. In this paper, we establish formal criteria for comparing two different measures for learning algorithms and we show theoretically and empirically that AUC is a better measure ( defined precisely) than accuracy. We then reevaluate well-established claims in machine learning based on accuracy using AUC and obtain interesting and surprising new results. For example, it has been well-established and accepted that Naive Bayes and decision trees are very similar in predictive accuracy. We show, however, that Naive Bayes is significantly better than decision trees in AUC. The conclusions drawn in this paper may make a significant impact on machine learning and data mining applications.
Keywords:
evaluation of learning algorithms
ROC
AUC of ROC
accuracy
Journal
IF:
10.4
Papers:
6.8K
Citations:
3.2W
Organization
No organization information available
Cited Papers
THE MEANING AND USE OF THE AREA UNDER A RECEIVER OPERATING CHARACTERISTIC (ROC) CURVE.png)
RADIOLOGY
RADIOLOGYIF15.2
PREAI
ShareSaveA simple generalisation of the area under the ROC curve for multiple class classification problemsMACHINE LEARNING
OAAI
MACHINE LEARNINGIF2.9
OAAIShareSaveThe use of the area under the roc curve in the evaluation of machine learning algorithmsPATTERN RECOGNITIONOAAI
PATTERN RECOGNITIONIF7.6
OAAIShareSaveShareSaveShareSaveIntegration of Mobile Devices into Ubiquitous Learning by the 21st Century TeenagersEducationOAAI
EducationIF0
OAAIShareSaveReal-Time Analysis of a Modified State Observer for Sensorless Induction Motor Drive Used in Electric Vehicle ApplicationsEnergiesOAAI
EnergiesIF0
OAAIShareSaveShareSave
View more