arrow
Return

ADAPTIVE ROBUST VARIABLE SELECTION

delete2014-02-01
delete184
delete
OA
AI
F
Fan, Jianqing *
F
Fan, Yingying
B
Barut, Emre
DOI:10.1214/13-AOS1191delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Heavy-tailed high-dimensional data are commonly encountered in various scientific fields and pose great challenges to modern statistical analysis. A natural procedure to address this problem is to use penalized quantile regression with weighted L-1-penalty, called weighted robust Lasso (WR-Lasso), in which weights are introduced to ameliorate the bias problem induced by the L-1-penalty. In the ultra-high dimensional setting, where the dimensionality can grow exponentially with the sample size, we investigate the model selection oracle property and establish the asymptotic normality of the WR-Lasso. We show that only mild conditions on the model error distribution are needed. Our theoretical results also reveal that adaptive choice of the weight vector is essential for the WR-Lasso to enjoy these nice asymptotic properties. To make the WR-Lasso practically feasible, we propose a two-step procedure, called adaptive robust Lasso (AR-Lasso), in which the weight vector in the second step is constructed based on the L-1-penalized quantile regression estimate from the first step. This two-step procedure is justified theoretically to possess the oracle property and the asymptotic normality. Numerical studies demonstrate the favorable finite-sample performance of the AR-Lasso.
Keywords:
Adaptive weighted L-1
high dimensions
oracle properties
robust regularization

Journal

Annals of Statistics cover
Annals of Statistics
IF:
3.7
Papers:
2.8K
Citations:
2.9W

Organization

U
university of southern california
Scholars:
4.7W
Papers: 3.8W
Citations: 51
P
Princeton University
Scholars:
2.1W
Papers: 2.3W
Citations: 5.1W
I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
researcher View more organizations
Cited Papers

Cited Papers

SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
err2009-08-01
err1.7K
errOAAI
errBickel, Peter J.; Ritov, Ya'acov; Tsybakov, Alexandre B.
errShare
errSave
Quasi-Likelihood and/or Robust Estimation in High Dimensions
err2012-11-01
err19
errOAAI
errvan de Geer, Sara; Mueller, Patric
errShare
errSave
Obsessions and Delusions: Separate and Distinct, or Overlapping?
err2014-11-07
err0
PREAI
errPaul C. Bermanzohn; Linda Porto; Phyllis B. Arlow; Sylvia Axelrod; Roslyn Stronger; Jeannette Martino-beyer; Simcha Pollack; Samuel G. Siris
errShare
errSave
Datenanalyse mit Mplus
err
IF0
err2011-01-01
err0
errOAAI
errChristian Geiser
errShare
errSave
High dimensional covariance matrix estimation using a factor model
err2008-11-01
err477
errOAAI
errFan, Jianqing; Fan, Yingying; Lv, Jinchi
errShare
errSave
researcher View more