arrow
返回

Hyperparameter selection for group-sparse regression: A probabilistic approach

delete2018-10-01
delete11
delete
OA
AI
T
Ted Kronvall *
A
Andreas Jakobsson
DOI:10.1016/j.sigpro.2018.04.021delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This work analyzes the effects on support recovery for different choices of the hyper- or regularization parameter in LASSO-like sparse and group-sparse regression problems. The hyperparameter implicitly selects the model order of the solution, and is typically set using cross-validation (CV). This may be computationally prohibitive for large-scale problems, and also often overestimates the model order, as CV optimizes for prediction error rather than support recovery. In this work, we propose a probabilistic approach to select the hyperparameter, by quantifying the type I error (false positive rate) using extreme value analysis. From Monte Carlo simulations, one may draw inference on the upper tail of the distribution of the spurious parameter estimates, and the regularization level may be selected for a specified false positive rate. By solving the e group-LASSO problem, the choice of hyperparameter becomes independent of the noise variance. Furthermore, the effects on the false positive rate caused by collinearity in the dictionary is discussed, including ways of circumventing them. The proposed method is compared to other hyperparameter-selection methods in terms of support recovery, false positive rate, false negative rate, and computational complexity. Simulated data illustrate how the proposed method outperforms CV and comparable methods in both computational complexity and support recovery. (C) 2018 Elsevier B.V. All rights reserved.
Keyword:
Sparse estimation
Group-LASSO
Regularization
Model order estimation
Sparsistency
Extreme value analysis
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Signal Processing 封面图
Signal Processing
IF:
3.6
论文数:
10.0K
被引数:
1.7W

机构

L
lund university
学者数:
4.1W
论文数: 3.9W
被引数: 54
引用论文

引用论文

An analysis of four different methods of producing focal cerebral ischemia with endothelin-1 in the rat
err2006-10-01
err0
PREAI
errV WINDLE; A SZYMANSKA; S GRANTERBUTTON; C WHITE; R BUIST; J PEELING; D CORBETT
err分享
err收藏
Least angle regression
err2004-04-01
err7.5K
errOAAI
errEfron, B; Hastie, T; Johnstone, I; Tibshirani, R
err分享
err收藏
High resolution sparse estimation of exponentially decaying N-dimensional signals
err2016-11-01
err19
PREAI
errSward, Johan; Adalbjornsson, Stefan I.; Jakobsson, Andreas
err分享
err收藏
An adaptive penalty multi-pitch estimator with self-regularization
err2016-10-01
err19
PREAI
errElvander, F.; Kronvall, T.; Adalbjornsson, S. I.; Jakobsson, A.
err分享
err收藏
err分享
err收藏
Group-sparse regression using the covariance fitting criterion
err2017-10-01
err14
PREAI
errKronvall, Ted; Adalbjornsson, Stefan Ingi; Nadig, Santhosh; Jakobsson, Andreas
err分享
err收藏
Characterization of outer membranes isolated from Treponema pallidum, the syphilis spirochete
err1995-11-01
err0
errOAAI
errJ D Radolf; E J Robinson; K W Bourell; D R Akins; S F Porcella; L M Weigel; J D Jones; M V Norgard
err分享
err收藏
学者 查看更多内容