arrow
Return

Robust variable structure discovery based on tilted empirical risk minimization

delete2023-01-14
delete1
PRE
AI
X
Xuelin Zhang
Y
Yingjie Wang
L
Liangxuan Zhu
陈洪 (Hong Chen)
李晗 cover
李晗 (Han Li)
L
Lingjuan Wu *
DOI:10.1007/s10489-022-04409-zdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Robust group lasso regression plays an important role in high-dimensional regression modeling such as biological data analysis for disease diagnosis and gene expression. However, most existing methods are optimized with prior variable structure knowledge under the traditional empirical risk minimization (ERM) framework, in which the estimators are excessively dependent on prior structure information and sensitive to outliers. To address this issue, we propose a new robust variable structure discovery method for group lasso based on a convergent bilevel optimization framework. In this paper, we adopt tilted empirical risk minimization (TERM) as the target function to improve the robustness of the estimator by assigning less weight to the outliers. Moreover, we modify the TERM objective function to calculate its Fenchel conjugate while maintaining its robust property, which is proven theoretically and empirically. Experimental results on both synthetic and real-world datasets show that the proposed method can improve the robust performance on prediction and variable structure discovery compared to the existing techniques.
Keywords:
Robustness
Group lasso
TERM
Variable structure discovery

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.5K
Citations:
1.7W

Organization

H
Huazhong Agricultural University
Scholars:
3.2W
Papers: 1.8W
Citations: 3.5W
C
china university of petroleum
Scholars:
4.1W
Papers: 2.7W
Citations: 30