返回
Classifier variability: Accounting for training and testing
DOI:10.1016/j.patcog.2011.12.024.png)
摘要
En 中文
We categorize the statistical assessment of classifiers into three levels: assessing the classification performance and its testing variability conditional on a fixed training set, assessing the performance and its variability that accounts for both training and testing, and assessing the performance averaging over training sets and its variability that accounts for both training and testing. We derived analytical expressions for the variance of the estimated AUC and provide freely available software implemented with an efficient computation algorithm. Our approach can be applied to assess any classifier that has ordinal (continuous or discrete) outputs. Applications to simulated and real datasets are presented to illustrate our methods. Published by Elsevier Ltd.
Keyword:
Classifier evaluation
Training variability
Classifier stability
U-statistics
AUC
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
The MicroArray Quality Control (MAQC)-IIII study of common practices for the development and validation of microarray-based predictive models微阵列质量控制 (MAQC)-IIII基于微阵列的预测模型的开发和验证的通用实践研究
NATURE BIOTECHNOLOGY
IF41.7
THE MEANING AND USE OF THE AREA UNDER A RECEIVER OPERATING CHARACTERISTIC (ROC) CURVE受试者工作特征 (ROC) 曲线下面积的含义和用途
RADIOLOGY
IF15.2
Temporal recalibration of motor and visual potentials in lag adaptation in voluntary movement
NeuroImage
IF0
Components-of-variance models and multiple-bootstrap experiments: An alternative method for random-effects, receiver operating characteristic analysis
ACADEMIC RADIOLOGY
IF3.9

