arrow
Return

Thresholded Lasso for high dimensional variable selection

delete2025-12-01
delete0
PRE
AI
Z
Zhou, Shuheng *
DOI:10.1007/s10463-025-00969-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Given n noisy samples with p dimensions, where n << p , we show that the multi-step thresholding procedure based on the Lasso - we call it the Thresholded Lasso, can accurately estimate a sparse vector beta is an element of & Ropf;(p) in a linear model Y = X beta + & varepsilon; , where Xis a design matrix and & varepsilon; similar to N(0, sigma I-2(n)) . Here I-n denotes the identity matrix. We show that under the restricted eigenvalue condition, it is possible to achieve the & lscr;(2) loss within a logarithmic factor of the ideal mean square error one would achieve with an oracle while selecting a sufficiently sparse model - hence achieving sparse oracle inequalities; the oracle would supply perfect information about which coordinates are non-zero and which are above the noise level. We also show the same prop-erty holds for the Gauss-Dantzig selector under a uniform uncertainty principle. Our simulation results match our theoretical analysis excellently.
Keywords:
Lasso
Gauss-Dantzig Selector
& ell
(1)
ideal model selection
oracle inequalities
restricted orthonormality
Restricted Eigenvalue condition
thresholding
random matrices

Journal

A
Annals of the Institute of Statistical Mathematics
IF:
0.6
Papers:
26
Citations:
2.1K

Organization

University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K