arrow
Return

BRIDGING FACTOR AND SPARSE MODELS

delete2023-08-01
delete8
delete
OA
AI
J
Jianqing Fan *
R
Ricardo Masini
M
Marcelo C. Medeiros
DOI:10.1214/23-AOS2304delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Factor and sparse models are widely used to impose a low-dimensional structure in high-dimensions. However, they are seemingly mutually exclusive. We propose a lifting method that combines the merits of these two models in a supervised learning methodology that allows for efficiently exploring all the information in high-dimensional datasets. The method is based on a flexible model for high-dimensional panel data with observable and/or latent common factors and idiosyncratic components. The model is called the factor-augmented regression model. It includes principal components and sparse regression as specific models, significantly weakens the crosssectional dependence, and facilitates model selection and interpretability. The method consists of several steps and a novel test for (partial) covariance structure in high dimensions to infer the remaining cross-section dependence at each step. We develop the theory for the model and demonstrate the validity of the multiplier bootstrap for testing a high-dimensional (partial) covariance structure. A simulation study and applications support the theory.
Keywords:
Factor models
penalized least-squares
high-dimensional inference
(partial) covari-ance structure
prediction
machine learning
supervised learning

Journal

Annals of Statistics cover
Annals of Statistics
IF:
3.7
Papers:
2.8K
Citations:
2.9W

Organization

P
Princeton University
Scholars:
2.1W
Papers: 2.3W
Citations: 5.1W
U
university of california davis
Scholars:
3.4W
Papers: 2.6W
Citations: 45
University of California System cover
University of California System
Scholars:
37.7W
Papers: 33.8W
Citations: 6.6K
researcher View more organizations
Cited Papers

Cited Papers

The Longitudinal Effects of Chronic Mediated Exposure to Political Violence on Ideological Beliefs About Political Conflicts Among Youths
err2015-06-01
err0
errOAAI
errShira Dvir Gvirsman; L. Rowell Huesmann; Eric F. Dubow; Simha F. Landau; Paul Boxer; Khalil Shikaki
errShare
errSave
Influence of antiganglioside antibodies on thyrotrophin binding and adenyl cyclase activity of thyroid plasma membranes
err1983-11-01
err0
PREAI
errAndrzej Gardas; Grażyna Adler; Aleksandra Lewartowska; Marta Faryna; Janusz Nauman
errShare
errSave
Taming the Factor Zoo: A Test of New Factors
err2020-02-27
err256
PREAI
errFeng, Guanhao; Giglio, Stefano; Xiu, Dacheng
errShare
errSave
Factor-adjusted regularized model selection
err2020-05-01
err52
errOAAI
errFan, Jianqing; Ke, Yuan; Wang, Kaizheng
errShare
errSave
Economic Predictions With Big Data: The Illusion of Sparsity
err2021-01-01
err62
errOAAI
errGiannone, Domenico; Lenza, Michele; Primiceri, Giorgio E.
errShare
errSave
Using AAC Technology to Access the World
err2012-03-01
err0
PREAI
errHoward C. Shane; Sarah Blackstone; Gregg Vanderheiden; Michael Williams; Frank DeRuyter
errShare
errSave
researcher View more