arrow
Return

CONSISTENT PARAMETER ESTIMATION FOR LASSO AND APPROXIMATE MESSAGE PASSING

delete2018-02-01
delete31
delete
OA
AI
A
Ali Mousavi *
A
Arian Maleki
R
Richard G. Baraniuk
DOI:10.1214/17-AOS1544delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
This paper studies the optimal tuning of the regularization parameter in LASSO or the threshold parameters in approximate message passing (AMP). Considering a model in which the design matrix and noise are zero-mean i.i.d. Gaussian, we propose a data-driven approach for estimating the regularization parameter of LASSO and the threshold parameters in AMP. Our estimates are consistent, that is, they converge to their asymptotically optimal values in probability as n, the number of observations, and p, the ambient dimension of the sparse vector, grow to infinity, while n/p converges to a fixed number delta. As a byproduct of our analysis, we will shed light on the asymptotic properties of the solution paths of LASSO and AMP.
Keywords:
LASSO
estimation
sparsity
approximate message passing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Annals of Statistics cover
Annals of Statistics
IF:
3.7
Papers:
2.8K
Citations:
2.9W

Organization

C
Columbia University
Scholars:
7.1W
Papers: 6.4W
Citations: 263
R
Rice University
Scholars:
1.4W
Papers: 1.2W
Citations: 2.6W
Cited Papers

Cited Papers

The crystal structure of CeCu6
err1960-11-01
err0
PREAI
errD. T. Cromer; A. C. Larson; R. B. Roof
errShare
errSave
SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
err2009-08-01
err1.7K
errOAAI
errBickel, Peter J.; Ritov, Ya'acov; Tsybakov, Alexandre B.
errShare
errSave
High-dimensional graphs and variable selection with the Lasso
err2006-06-01
err2.9K
errOAAI
errMeinshausen, Nicolai; Buehlmann, Peter
errShare
errSave
Least angle regression
err2004-04-01
err7.5K
errOAAI
errEfron, B; Hastie, T; Johnstone, I; Tibshirani, R
errShare
errSave
Toll-Like Receptor Polymorphisms Are Associated With Increased Neurosyphilis Risk
err2014-07-01
err0
errOAAI
errChristina M. Marra; Sharon K. Sahi; Lauren C. Tantalo; Emily L. Ho; Shelia B. Dunaway; Trudy Jones; Thomas R. Hawn
errShare
errSave
researcher View more