.png){kind=icon}
返回
Using AUC and accuracy in evaluating learning algorithms
.png){kind=icon}
OA
AI
DOI：10.1109/TKDE.2005.50.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The area under the ROC ( Receiver Operating Characteristics) curve, or simply AUC, has been traditionally used in medical diagnosis since the 1970s. It has recently been proposed as an alternative single-number measure for evaluating the predictive ability of learning algorithms. However, no formal arguments were given as to why AUC should be preferred over accuracy. In this paper, we establish formal criteria for comparing two different measures for learning algorithms and we show theoretically and empirically that AUC is a better measure ( defined precisely) than accuracy. We then reevaluate well-established claims in machine learning based on accuracy using AUC and obtain interesting and surprising new results. For example, it has been well-established and accepted that Naive Bayes and decision trees are very similar in predictive accuracy. We show, however, that Naive Bayes is significantly better than decision trees in AUC. The conclusions drawn in this paper may make a significant impact on machine learning and data mining applications.
Keyword:
evaluation of learning algorithms
ROC
AUC of ROC
accuracy
期刊
IF:
10.4
论文数:
6.8K
被引数:
3.2W
机构
暂无机构信息
引用论文
THE MEANING AND USE OF THE AREA UNDER A RECEIVER OPERATING CHARACTERISTIC (ROC) CURVE受试者工作特征 (ROC) 曲线下面积的含义和用途.png)
RADIOLOGY
RADIOLOGYIF15.2
PREAI
分享收藏A simple generalisation of the area under the ROC curve for multiple class classification problems多类分类问题的ROC曲线下面积的简单概括MACHINE LEARNING
OAAI
MACHINE LEARNINGIF2.9
OAAI分享收藏The use of the area under the roc curve in the evaluation of machine learning algorithmsroc曲线下面积在机器学习算法评价中的应用PATTERN RECOGNITIONOAAI
PATTERN RECOGNITIONIF7.6
OAAI分享收藏Integration of Mobile Devices into Ubiquitous Learning by the 21st Century TeenagersEducationOAAI
EducationIF0
OAAI分享收藏Real-Time Analysis of a Modified State Observer for Sensorless Induction Motor Drive Used in Electric Vehicle ApplicationsEnergiesOAAI
EnergiesIF0
OAAI分享收藏
查看更多内容