arrow
返回

Robust High-Dimensional Factor Models with Applications to Statistical Machine Learning

delete2021-05-01
delete30
delete
OA
AI
J
Jianqing Fan *
K
Kaizheng Wang
Y
Yiqiao Zhong
Z
Ziwei Zhu
DOI:10.1214/20-STS785delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Factor models are a class of powerful statistical models that have been widely used to deal with dependent measurements that arise frequently from various applications from genomics and neuroscience to economics and finance. As data are collected at an ever-growing scale, statistical machine learning faces some new challenges: high dimensionality, strong dependence among observed variables, heavy-tailed variables and heterogeneity. High-dimensional robust factor analysis serves as a powerful toolkit to conquer these challenges. This paper gives a selective overview on recent advance on high-dimensional factor models and their applications to statistics including Factor-Adjusted Robust Model selection (FarmSelect) and Factor-Adjusted Robust Multiple testing (FarmTest). We show that classical methods, especially principal component analysis (PCA), can be tailored to many new problems and provide powerful tools for statistical estimation and inference. We highlight PCA and its connections to matrix perturbation theory, robust statistics, random projection, false discovery rate, etc., and illustrate through several applications how insights from these fields yield solutions to modern challenges. We also present far-reaching connections between factor models and popular statistical learning problems, including network analysis and low-rank matrix recovery.
Keyword:
Factor model
PCA
covariance estimation
perturbation bounds
robustness
random sketch
FarmSelect
FarmTest

期刊

Statistical Science 封面图
Statistical Science
IF:
3.4
论文数:
1.0K
被引数:
8.7K

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
P
Princeton University
学者数:
2.1W
论文数: 2.3W
被引数: 5.1W
S
Stanford University
学者数:
9.6W
论文数: 8.2W
被引数: 17.0W
U
university of michigan system
学者数:
9.1W
论文数: 8.6W
被引数: 133
学者 查看更多机构
引用论文

引用论文

Preconditioning for feature selection and regression in high-dimensional problems'
err2008-08-01
err95
errOAAI
errPaul, Debashis; Bair, Eric; Hastie, Trevor; Tibshirani, Robert
err分享
err收藏
SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
err2009-08-01
err1.7K
errOAAI
errBickel, Peter J.; Ritov, Ya'acov; Tsybakov, Alexandre B.
err分享
err收藏
Linienführung
err
IF0
err1925-01-01
err0
PREAI
errErich Giese; Otto Blum; Kurt Risch
err分享
err收藏
Raman excitation spectra of aggregate modes of 2,2′-cyanine
err1990-06-01
err0
PREAI
errD.L. Akins; J.W. Macklin; L.A. Parker; H.-R. Zhu
err分享
err收藏
学者 查看更多内容