返回
High-dimensional quantile regression: Convolution smoothing and concave regularization
DOI:10.1111/rssb.12485.png)
摘要
En 中文
l(1)-penalized quantile regression (QR) is widely used for analysing high-dimensional data with heterogeneity. It is now recognized that the l(1)-penalty introduces non-negligible estimation bias, while a proper use of concave regularization may lead to estimators with refined convergence rates and oracle properties as the signal strengthens. Although folded concave penalized M-estimation with strongly convex loss functions have been well studied, the extant literature on QR is relatively silent. The main difficulty is that the quantile loss is piecewise linear: it is non-smooth and has curvature concentrated at a single point. To overcome the lack of smoothness and strong convexity, we propose and study a convolution-type smoothed QR with iteratively reweighted l(1)-regularization. The resulting smoothed empirical loss is twice continuously differentiable and (provably) locally strongly convex with high probability. We show that the iteratively reweighted l(1)-penalized smoothed QR estimator, after a few iterations, achieves the optimal rate of convergence, and moreover, the oracle rate and the strong oracle property under an almost necessary and sufficient minimum signal strength condition. Extensive numerical studies corroborate our theoretical results.
Keyword:
concave regularization
convolution
minimum signal strength
oracle property
quantile regression
期刊
J
IF:
3.6
论文数:
1.5K
被引数:
3.2W
机构
引用论文
SLOPE MEETS LASSO: IMPROVED ORACLE BOUNDS AND OPTIMALITY斜率满足套索: 改进的ORACLE边界和最优性
ANNALS OF STATISTICS
IF3.7
STATISTICAL CONSISTENCY AND ASYMPTOTIC NORMALITY FOR HIGH-DIMENSIONAL ROBUST M-ESTIMATORS高维鲁棒M-估计的统计一致性和渐近正态性
ANNALS OF STATISTICS
IF3.7
A Unified Framework for High-Dimensional Analysis of M-Estimators with Decomposable Regularizers
STATISTICAL SCIENCE
IF3.4

