arrow
返回

High-Dimensional Variable Selection With Reciprocal L1-Regularization

delete2016-01-15
delete37
PRE
AI
Q
Qifan Song *
F
Faming Liang
DOI:10.1080/01621459.2014.984812delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
During the past decade, penalized likelihood methods have been widely used in variable selection problems, where the penalty functions are typically symmetric about 0, continuous and nondecreasing in (0, infinity). We propose a new penalized likelihood method, reciprocal Lasso (or in short, rLasso), based on a new class of penalty functions that are decreasing in (0,infinity), discontinuous at 0, and converge to infinity when the coefficients approach zero. The new penalty functions give nearly zero coefficients infinity penalties; in contrast, the conventional penalty functions give nearly zero coefficients nearly zero penalties (e.g., Lasso and smoothly clipped absolute deviation [SCAD]) or constant penalties (e.g., L-0 penalty). This distinguishing feature makes rLasso very attractive for variable selection. It can effectively avoid to select overly dense models. We establish the consistency of the rLasso for variable selection and coefficient estimation under both the low-and high-dimensional settings. Since the rLasso penalty functions induce an objective function with multiple local minima, we also propose an efficient Monte Carlo optimization algorithm to solve the involved minimization problem. Our simulation results show that the rLasso outperforms other popular penalized likelihood methods, such as Lasso, SCAD, minimax concave penalty, sure independence screening, interative sure independence screening, and extended Bayesian information criterion. It can produce sparser and more accurate coefficient estimates, and catch the true model with a higher probability. Supplementary materials for this article are available online.
Keyword:
Lasso
Penalized likelihood methods
Reciprocal lasso
Stochastic approximation annealing
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

J
Journal of the American Statistical Association
IF:
3
论文数:
5.2K
被引数:
4.8W

机构

Purdue University System 封面图
Purdue University System
学者数:
3.9W
论文数: 3.6W
被引数: 66
P
Purdue University
学者数:
2.7W
论文数: 2.1W
被引数: 147
引用论文

引用论文

err分享
err收藏
Least angle regression
err2004-04-01
err7.5K
errOAAI
errEfron, B; Hastie, T; Johnstone, I; Tibshirani, R
err分享
err收藏
err分享
err收藏
Evaluation of the Psychometric Properties of the Functional Assessment of Cancer Therapy-Cervix Questionnaire in Brazil巴西功能性癌症治疗评估-宫颈癌问卷的心理测量学特性评估
err2013-10-16
err0
errOAAI
errCristiane Menezes Sirna Fregnani; José Humberto Tavares Guerreiro Fregnani; Maria do Rosário Dias de Oliveira Latorre; Ana Maria de Almeida
err分享
err收藏
学者 查看更多内容