arrow
返回

Optimal ROC-Based Classification and Performance Analysis under Bayesian Uncertainty Models

delete2016-07-01
delete8
PRE
AI
L
Lori A. Dalton *
DOI:10.1109/TCBB.2015.2465966delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Popular tools to evaluate classifier performance are the false positive rate (FPR), true positive rate (TPR), receiver operator characteristic (ROC) curve, and area under the curve (AUC). Typically, these quantities are estimated from training data using simple resampling and counting methods, which have been shown to perform poorly when the sample size is small, as is typical in many applications. This work takes a model-based approach in classifier training and performance analysis, where we assume the true population densities are members of an uncertainty class of distributions. Given a prior over the uncertainty class and data, we form a posterior and derive optimal mean-squared-error (MSE) FPR and TPR estimators, as well as the sample-conditioned MSE performance of these estimators. The theory also naturally leads to optimal ROC and AUC estimators. Finally, we develop a Neyman-Pearson-based approach to optimal classifier design, which maximizes the estimated TPR for a given estimated FPR. These tools are optimal over the uncertainty class of distributions given the sample, and are available in closed form or can be easily approximated for many models. Applications are demonstrated on both synthetic and real genomic data. MATLAB code and simulations results are available in the online supplementary material.
Keyword:
Classification
error estimation
Bayesian estimation
receiver operating characteristic
area under the curve
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE-ACM Transactions on Computational Biology and Bioinformatics
IF:
3.4
论文数:
3.3K
被引数:
6.4K

机构

U
University System of Ohio
学者数:
15.5W
论文数: 13.0W
被引数: 200
引用论文

引用论文

err1998-01-01
err0
PREAI
errH.-C. Chang
err分享
err收藏
Albumin Differences among Ranid Frogs: Taxonomic and Phylogenetic Implications
err1973-03-01
err0
PREAI
errDonald G. Wallace; Mary-Claire King; Allan C. Wilson
err分享
err收藏
学者 查看更多内容