arrow
Return

Model Selection for High-Dimensional Quadratic Regression via Regularization

delete2018-02-08
delete81
delete
OA
AI
N
Ning Hao
Y
Yang Feng
H
Hao Helen Zhang *
DOI:10.1080/01621459.2016.1264956delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Quadratic regression (QR) models naturally extend linear models by considering interaction effects between the covariates. To conduct model selection in QR, it is important to maintain the hierarchical model structure between main effects and interaction effects. Existing regularization methods generally achieve this goal by solving complex optimization problems, which usually demands high computational cost and hence are not feasible for high-dimensional data. This article focuses on scalable regularization methods for model selection in high-dimensional QR. We first consider two-stage regularization methods and establish theoretical properties of the two-stage LASSO. Then, a new regularization method, called regularization algorithm under marginality principle (RAMP), is proposed to compute a hierarchy-preserving regularization solution path efficiently. Both methods are further extended to solve generalized QR models. Numerical results are also shown to demonstrate performance of the methods.
Keywords:
Generalized quadratic regression
Interaction selection
LASSO
Marginality principle
Variable selection
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

J
Journal of the American Statistical Association
IF:
3
Papers:
5.1K
Citations:
4.8W

Organization

C
Columbia University
Scholars:
7.1W
Papers: 6.4W
Citations: 263
U
University of Arizona
Scholars:
3.6W
Papers: 3.2W
Citations: 980