.png){kind=icon}
Return
PERMUTATION METHODS FOR FACTOR ANALYSIS AND PCA
.png){kind=icon}
OA
AI
DOI：10.1214/19-AOS1907.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Researchers often have datasets measuring features xij of samples, such as test scores of students. In factor analysis and PCA, these features are thought to be influenced by unobserved factors, such as skills. Can we determine how many components affect the data? This is an important problem, because decisions made here have a large impact on all downstream data analysis. Consequently, many approaches have been developed. Parallel Analysis is a popular permutation method: it randomly scrambles each feature of the data. It selects components if their singular values are larger than those of the permuted data. Despite widespread use, as well as empirical evidence for its accuracy, it currently has no theoretical justification. In this paper, we show that parallel analysis (or permutation methods) consistently select the large components in certain high-dimensional factor models. However, when the signals are too large, the smaller components are not selected. The intuition is that permutations keep the noise invariant, while destroying the low-rank signal. This provides justification for permutation methods. Our work also uncovers drawbacks of permutation methods, and paves the way to improvements.
Keywords:
Factor analysis
PCA
parallel analysis
permutation methods
high-dimensional asymptotics
Journal
IF:
3.7
Papers:
2.8K
Citations:
2.9W
Organization
Cited Papers
Recognition Acuity, Grating Acuity, Contrast Sensitivity, and Visual Fields in 6-Year-Old Children
PREAI
ShareSaveFINITE SAMPLE APPROXIMATION RESULTS FOR PRINCIPAL COMPONENT ANALYSIS: A MATRIX PERTURBATION APPROACH.png)
ANNALS OF STATISTICSOAAI
ANNALS OF STATISTICSIF3.7
OAAIShareSaveHIGH-DIMENSIONAL ASYMPTOTICS OF PREDICTION: RIDGE REGRESSION AND CLASSIFICATIONANNALS OF STATISTICS
OAAI
ANNALS OF STATISTICSIF3.7
OAAIShareSaveShareSaveShareSaveShareSave
View more