arrow
Return

Factor-Adjusted Model Averaging

delete2026-01-21
delete0
PRE
AI
W
Wenhui Li
X
Xinyu Zhang *
DOI:10.1080/01621459.2025.2576188delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a model averaging method for high-dimensional regression with highly correlated covariates. We use a factor structure to model the covariate dependence, allowing the covariates to be decomposed into two uncorrelated or weakly correlated latent components: common factors and idiosyncratic components. The number of common factors is allowed to diverge. We average estimators from factor-adjusted candidate models with augmented predictors composed of estimated common factors and idiosyncratic components. We prove the asymptotic optimality in the sense of achieving the lowest squared loss and the consistency when correctly specified models exist in the model space. Numerical experiments and a real-data analysis illustrate the promising performance of the proposed method. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.
Keywords:
Factor analysis
Frequentist model averaging
High-dimensional regression
Jackknife model averaging
Prediction

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.1K
Citations:
4.8W

Organization

U
university of science and technology of china
Scholars:
1.0W
Papers: 3.9K
Citations: 3
C
chinese academy of sciences
Scholars:
56.2W
Papers: 44.8W
Citations: 704