.png){kind=icon}
返回
Don't lose samples to estimation
.png){kind=icon}
OA
AI
DOI：10.1016/j.patter.2022.100612.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In a typical predictive modeling task, we are asked to produce a final predictive model to employ operationally for predictions, as well as an estimate of its out-of-sample predictive performance. Typically, analysts hold out a portion of the available data, called a Test set, to estimate the model predictive performance on unseen (out-of-sample) records, thus ``losing these samples to estimation.'' However, this practice is unacceptable when the total sample size is low. To avoid losing data to estimation, we need a shift in our perspective: we do not estimate the performance of a specific model instance; we estimate the performance of the pipeline that produces the model. This pipeline is applied on all available samples to produce the final model; no samples are lost to estimation. An estimate of its performance is provided by training the same pipeline on subsets of the samples. When multiple pipelines are tried, additional considerations that correct for the ``winner's curse'' need to be in place.
Keyword:
ERROR RATE
BIAS CORRECTION
MICROARRAY
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.4
论文数:
951
被引数:
3.6K
机构
引用论文
Growth-dependent alterations in oligomannosyl glycopeptides expressed in Sindbis virus glycoproteins.png)
Biochemistry
BiochemistryIF0
PREAI
分享收藏Oligonucleotide microarray for prediction of early intrahepatic recurrence of hepatocellular carcinoma after curative resection寡核苷酸芯片预测肝癌切除术后早期肝内复发LANCET
LANCETIF88.5
PREAI
分享收藏Bootstrapping the out-of-sample predictions for efficient and accurate cross-validationMACHINE LEARNINGOAAI
MACHINE LEARNINGIF2.9
OAAI分享收藏
查看更多内容