arrow
返回

EFFICIENT SPARSE HESSIAN-BASED SEMISMOOTH NEWTON ALGORITHMS FOR DANTZIG SELECTOR\ast

delete2021-12-21
delete3
PRE
AI
S
Sheng Fang
Y
Yong-Jin Liu *
X
Xianzhu Xiong
DOI:10.1137/20M1364643delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
This paper focuses on efficient algorithms for finding the Dantzig selector which was first proposed by Cande`\s and Tao as an effective variable selection technique in the linear regression. This paper first reformulates the Dantzig selector problem as an equivalent convex composite optimization problem and proposes a semismooth Newton augmented Lagrangian (SSNAL) algorithm to solve the equivalent form. This paper also applies a proximal point dual semismooth Newton (PPDSSN) algorithm to solve another equivalent form of the Dantzig selector problem. Comprehensive results on the global convergence and local asymptotic superlinear convergence of the SSNAL and PPDSSN algorithms are characterized under very mild conditions. The computational costs of a semismooth Newton algorithm for solving the subproblems involved in the SSNAL and PPDSSN algorithms can be cheap by fully exploiting the second order sparsity and employing efficient techniques. Numerical experiments on the Dantzig selector problem with synthetic and real data sets demonstrate that the SSNAL and PPDSSN algorithms substantially outperform the state-of-the-art first order algorithms even for the required low accuracy, and the proposed algorithms are able to solve the large-scale problems robustly and efficiently to a relatively high accuracy.
Keyword:
Dantzig selector
semismooth Newton method
augmented Lagrangian method
proximal point method

期刊

SIAM Journal on Scientific Computing 封面图
SIAM Journal on Scientific Computing
IF:
2.6
论文数:
5.1K
被引数:
1.8W

机构

F
fuzhou university
学者数:
3.3W
论文数: 2.1W
被引数: 31
引用论文

引用论文

SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR
err2009-08-01
err1.7K
errOAAI
errBickel, Peter J.; Ritov, Ya'acov; Tsybakov, Alexandre B.
err分享
err收藏
err分享
err收藏
Fractional cascading: I. A data structuring technique
err1986-11-01
err0
PREAI
errBernard Chazelle; Leonidas J. Guibas
err分享
err收藏
学者 查看更多内容