Graph-based Square-Root Estimation for Sparse Linear Regression

Peili Li

doi:10.1080/10618600.2025.2571164

Return

Graph-based Square-Root Estimation for Sparse Linear Regression

2025-11-01

PRE

DOI：10.1080/10618600.2025.2571164

Original

Original request for help

Save

Abstract

En 中文

Sparse linear regression is one of the classic problems in the field of statistics, which has deep connections and high intersections with optimization, computation, and machine learning. To address the effective handling of high-dimensional data, the diversity of real noise, and the challenges in estimating standard deviation of noise, we propose a novel and general graph-based square-root estimation (GSRE) model for sparse linear regression. Specifically, we use square-root-loss function to encourage the estimators to be independent of the unknown standard deviation of error terms and design a sparse regularization term by using the graphical structure among predictors in a node-by-node form. Based on the predictor graphs with special structure, we highlight the generality by analyzing that the model in this article is equivalent to several classic regression models. Theoretically, we also analyze the finite sample bounds, asymptotic normality and model selection consistency of GSRE method without relying on standard deviation of error terms. In terms of computation, we employ the fast and efficient alternating direction method of multipliers. Finally, based on a large number of simulated and real data with various types of noise, we demonstrate the performance advantages of the proposed method in estimation, prediction and model selection. Supplementary materials for this article are available online.

Keywords:

Alternating direction method of multipliers

Graphical structure among predictors

Oracle property

Sparse linear regression

Square-root-loss function