arrow
返回

High-dimensional principal component analysis with heterogeneous missingness

delete2022-11-20
delete12
delete
OA
AI
Z
Ziwei Zhu
T
Tengyao Wang
R
Richard J. Samworth *
DOI:10.1111/rssb.12550delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We study the problem of high-dimensional Principal Component Analysis (PCA) with missing observations. In a simple, homogeneous observation model, we show that an existing observed-proportion weighted (OPW) estimator of the leading principal components can (nearly) attain the minimax optimal rate of convergence, which exhibits an interesting phase transition. However, deeper investigation reveals that, particularly in more realistic settings where the observation probabilities are heterogeneous, the empirical performance of the OPW estimator can be unsatisfactory; moreover, in the noiseless case, it fails to provide exact recovery of the principal components. Our main contribution, then, is to introduce a new method, which we call primePCA, that is designed to cope with situations where observations may be missing in a heterogeneous manner. Starting from the OPW estimator, primePCA iteratively projects the observed entries of the data matrix onto the column space of our current estimate to impute the missing entries, and then updates our estimate by computing the leading right singular space of the imputed data matrix. We prove that the error of primePCAconverges to zero at a geometric rate in the noiseless case, and when the signal strength is not too small. An important feature of our theoretical guarantees is that they depend on average, as opposed to worst-case, properties of the missingness mechanism. Our numerical studies on both simulated and real data reveal that primePCA exhibits very encouraging performance across a wide range of scenarios, including settings where the data are not Missing Completely At Random.
Keyword:
heterogeneous missingness
high-dimensional statistics
iterative projections
missing data
principal component analysis
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

J
Journal of the Royal Statistical Society Series B-Statistical Methodology
IF:
3.6
论文数:
1.5K
被引数:
3.2W

机构

U
University of Cambridge
学者数:
7.7W
论文数: 7.1W
被引数: 13.7W
引用论文

引用论文

Quantum Optics of Spin Waves through ac Stark Modulation
err2019-02-14
err0
errOAAI
errMichał Parniak; Mateusz Mazelanik; Adam Leszczyński; Michał Lipka; Michał Dąbrowski; Wojciech Wasilewski
err分享
err收藏
Complementation of Wild-Type and Drug-Resistant Hepatitis B Virus Genomes to Maintain Viral Replication and Rescue Virion Production under Nucleos(t)ide Analogs
err2019-06-19
err0
errOAAI
errChunchen Wu; Baolin Li; Xiaoyong Zhang; Kaitao Zhao; Yingshan Chen; Yifei Yuan; Yan Liu; Rongjuan Chen; Dongping Xu; Xinwen Chen; Mengji Lu
err分享
err收藏
Matrix Completion With Noise带噪声的矩阵补全
err2010-06-01
err1.4K
errOAAI
errCandes, Emmanuel J.; Plan, Yaniv
err分享
err收藏
err分享
err收藏
学者 查看更多内容