.png){kind=icon}
返回
Large-Scale Correlation Screening
.png){kind=icon}
OA
AI
DOI：10.1198/jasa.2011.tm11015.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This article addresses the problem of screening for variables with high correlations in high-dimensional data in which there can be many fewer samples than variables. We focus on threshold-based correlation screening methods for three related applications: screening for variables with large correlations within a single treatment (autocorrelation screening), screening for variables with large cross-correlations over two treatments (cross-correlation screening), and screening for variables that have persistently large autocorrelations over two treatments (persistent-correlation screening). The novelty of correlation screening is that it identifies a smaller number of variables that are highly correlated with others compared with identifying a number of correlation parameters. Correlation screening suffers from a phase transition phenomenon; as the correlation threshold decreases, the number of discoveries increases abruptly. We obtain asymptotic expressions for the mean number of discoveries and the phase transition thresholds as a function of the number of samples, the number of variables, and the joint sample distribution. We also show that under a weak dependency condition, the number of discoveries is dominated by a Poisson random variable giving an asymptotic expression for the false-positive rate. The correlation screening approach yields tremendous dividends in terms of the type and strength of the asymptotic results that can be obtained. It also overcomes some of the major hurdles faced by existing methods in the literature, because correlation screening is naturally scalable to high dimensions. Numerical results strongly validate the theory presented here. We illustrate the application of the correlation screening methodology on a large-scale gene-expression dataset, revealing a few influential variables that exhibit significant correlation over multiple treatments. This article has supplementary material online.
Keyword:
Chen-Stein
False discovery
High-dimensional inference
Phase transition
Poisson limit
Renyi entropy
Sparsity
Thresholding
Variable selection
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
J
IF:
3
论文数:
5.2K
被引数:
4.8W
机构
引用论文
Compression and Air Storage Systems for Small Size CAES Plants: Design and Off-design Analysis小型CAES工厂的压缩和空气存储系统: 设计和非设计分析OAAI
OAAI分享收藏分享收藏LIMITING LAWS OF COHERENCE OF RANDOM MATRICES WITH APPLICATIONS TO TESTING COVARIANCE STRUCTURE AND CONSTRUCTION OF COMPRESSED SENSING MATRICES.png)
ANNALS OF STATISTICSOAAI
ANNALS OF STATISTICSIF3.7
OAAI分享收藏Fuel cell system for SUAV using chemical hydride - II. Lightweight fuel cell propulsion system采用化学氢化物的SUAV燃料电池系统 - II. 轻量化燃料电池推进系统
OAAI
OAAI分享收藏
查看更多内容