arrow
返回

p-Values for High-Dimensional Regression

delete2009-12-01
delete355
delete
OA
AI
N
Nicolai Meinshausen *
L
Lukas Meier
P
Peter Bühlmann
DOI:10.1198/jasa.2009.tm08647delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Assigning significance in high-dimensional regression is challenging. Most computationally efficient selection algorithms cannot guard against inclusion of noise variables. Asymptotically valid p-values are not available. An exception is a recent proposal by Wasserman and Roeder that splits the data into two parts. The number of variables is then reduced to a manageable size using the first split, while classical variable selection techniques can be applied to the remaining variables, using the data from the second split. This yields asymptotic error control under minimal conditions. This involves a one-time random split of the data, however. Results are sensitive to this arbitrary choice, which amounts to a p-value lottery and makes it difficult to reproduce results. Here we show that inference across multiple random splits can be aggregated while maintaining asymptotic control over the inclusion of noise variables. We show that the resulting p-values can be used for control of both family-wise error and false discovery rate. In addition, the proposed aggregation is shown to improve power while reducing the number of falsely selected variables substantially.
Keyword:
Data splitting
False discovery rate
Family-wise error rate
High-dimensional variable selection
Multiple comparisons

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
U
university of oxford
学者数:
9.8W
论文数: 8.6W
被引数: 137
引用论文

引用论文

SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
err2009-08-01
err1.7K
errOAAI
errBickel, Peter J.; Ritov, Ya'acov; Tsybakov, Alexandre B.
err分享
err收藏
High-dimensional graphs and variable selection with the Lasso
err2006-06-01
err2.9K
errOAAI
errMeinshausen, Nicolai; Buehlmann, Peter
err分享
err收藏
学者 查看更多内容