.png){kind=icon}
返回
Methods for correcting inference based on outcomes predicted by machine learning
.png){kind=icon}
OA
AI
DOI：10.1073/pnas.2001238117.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Many modern problems in medicine and public health leverage machine-learning methods to predict outcomes based on observable covariates. In a wide array of settings, predicted outcomes are used in subsequent statistical analysis, often without accounting for the distinction between observed and predicted outcomes. We call inference with predicted outcomes postprediction inference. In this paper, we develop methods for correcting statistical inference using outcomes predicted with arbitrarily complicated machine-learning models including random forests and deep neural nets. Rather than trying to derive the correction from first principles for each machine-learning algorithm, we observe that there is typically a low-dimensional and easily modeled representation of the relationship between the observed and predicted outcomes. We build an approach for postprediction inference that naturally fits into the standard machine-learning framework where the data are divided into training, testing, and validation sets. We train the prediction model in the training set, estimate the relationship between the observed and predicted outcomes in the testing set, and use that relationship to correct subsequent inference in the validation set. We show our postprediction inference (postpi) approach can correct bias and improve variance estimation and subsequent statistical inference with predicted outcomes. To show the broad range of applicability of our approach, we show postpi can improve inference in two distinct fields: modeling predicted phenotypes in repurposed gene expression data and modeling predicted causes of death in verbal autopsy data. Our method is available through an open-source package: https://github.com/leekgroup/postpi.
Keyword:
statistics
machine learning
postprediction inference
interpretability
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
P
IF:
9.1
论文数:
10.8W
被引数:
73.5W
机构
引用论文
Intermittent Consequences and Problem Solving: The Experimental Control of “Superstitious” Beliefs
PREAI
分享收藏Normalization of RNA-seq data using factor analysis of control genes or samples使用对照基因或样品的因子分析对rna-seq数据进行归一化.png)
NATURE BIOTECHNOLOGYOAAI
NATURE BIOTECHNOLOGYIF41.7
OAAI分享收藏分享收藏分享收藏分享收藏Scalable and accurate deep learning with electronic health records通过电子健康记录进行可扩展且准确的深度学习NPJ DIGITAL MEDICINEOAAI
NPJ DIGITAL MEDICINEIF15.1
OAAI分享收藏
查看更多内容