arrow
返回

Linear-Time Algorithm for Learning Large-Scale Sparse Graphical Models

delete2019-01-01
delete9
delete
OA
AI
S
Salar Fattahi
R
Richard Y. Zhang
S
Somayeh Sojoudi *
DOI:10.1109/ACCESS.2018.2890583delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
We consider the graphical lasso, a popular optimization problem for learning the sparse representations of high-dimensional datasets, which is well-known to be computationally expensive for large-scale problems. A recent line of results has shown-under mild assumptions-that the sparsity pattern of the graphical lasso estimator can be retrieved by soft-thresholding the sample covariance matrix. Based on this result, a closed-form solution has been obtained that is optimal when the thresholded sample covariance matrix has an acyclic structure. In this paper, we prove an extension of this result to generalized graphical lasso (GGL), where additional sparsity constraints are imposed based on prior knowledge. Furthermore, we describe a recursive closed-form solution for the problem when the thresholded sample covariance matrix is chordal. By building upon this result, we describe a novel Newton-Conjugate Gradient algorithm that can efficiently solve the GGL with general structures. Assuming that the thresholded sample covariance matrix is sparse with a sparse Cholesky factorization, we prove that the algorithm converges to an epsilon-accurate solution in O(n log(1/epsilon)) time and O(n) memory. The algorithm is highly efficient in practice: we solve instances with as many as 200 000 variables to 7-9 digits of accuracy in less than an hour on a standard laptop computer running MATLAB.
Keyword:
Optimization
graphical models
numerical algorithms
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
University of California Berkeley
学者数:
3.5W
论文数: 2.8W
被引数: 11.3W
University of California System 封面图
University of California System
学者数:
37.5W
论文数: 33.7W
被引数: 6.6K
引用论文

引用论文

Application of Y-chromosomal microdeletions in a homicide case
err2020-09-01
err0
PREAI
errXingyi Yang; Hong Liu; Changhui Liu; Quyi Xu; Dian Yang; XiaoLong Han; Ling Chen; Bo Lei; Chao Liu; Weian Du
err分享
err收藏
THE BENEFIT OF GROUP SPARSITY
err2010-08-01
err397
errOAAI
errHuang, Junzhou; Zhang, Tong
err分享
err收藏
High-dimensional graphs and variable selection with the Lasso
err2006-06-01
err2.9K
errOAAI
errMeinshausen, Nicolai; Buehlmann, Peter
err分享
err收藏
err分享
err收藏
err分享
err收藏
Next-Generation Transparent Conducting Oxides for Photovoltaic Cells: an Overview
err2011-03-21
err0
PREAI
errDavid Ginley; Tim Coutts; John Perkins; David Young; Xiaonan Li; Phil Parilla
err分享
err收藏
Plasticizers
err2011-01-01
err0
PREAI
errAllen D. Godwin
err分享
err收藏
学者 查看更多内容