arrow
返回

Variational Bayesian sparse additive matrix factorization

delete2013-05-04
delete13
delete
OA
AI
S
Shinichi Nakajima *
M
Masashi Sugiyama
S
S. Derin Babacan
DOI:10.1007/s10994-013-5347-6delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Principal component analysis (PCA) approximates a data matrix with a low-rank one by imposing sparsity on its singular values. Its robust variant can cope with spiky noise by introducing an element-wise sparse term. In this paper, we extend such sparse matrix learning methods, and propose a novel framework called sparse additive matrix factorization (SAMF). SAMF systematically induces various types of sparsity by a Bayesian regularization effect, called model-induced regularization. Although group LASSO also allows us to design arbitrary types of sparsity on a matrix, SAMF, which is based on the Bayesian framework, provides inference without any requirement for manual parameter tuning. We propose an efficient iterative algorithm called the mean update (MU) for the variational Bayesian approximation to SAMF, which gives the global optimal solution for a large subset of parameters in each step. We demonstrate the usefulness of our method on benchmark datasets and a foreground/background video separation problem.
Keyword:
Variational Bayes
Robust PCA
Matrix factorization
Sparsity
Model-induced regularization

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

I
Institute of Science Tokyo
学者数:
3.2W
论文数: 2.7W
被引数: 117
T
Tokyo Institute of Technology
学者数:
1.1W
论文数: 9.0K
被引数: 1.9W
N
nikon corporation
学者数:
139
论文数: 88
被引数: 0
学者 查看更多机构
引用论文

引用论文

Bayesian Robust Principal Component Analysis
err2011-12-01
err234
errOAAI
errDing, Xinghao; He, Lihan; Carin, Lawrence
err分享
err收藏
Social class, parental education, and obesity prevalence in a study of six-year-old children in Germany
err2005-03-15
err0
PREAI
errA Lamerz; J Kuepper-Nybelen; C Wehle; N Bruning; G Trost-Brinkhues; H Brenner; J Hebebrand; B Herpertz-Dahlmann
err分享
err收藏
Cognitive Stimulation and Cognitive and Functional Decline in Alzheimer's Disease: The Cache County Dementia Progression Study
err2011-03-25
err0
errOAAI
errK. A. Treiber; M. C. Carlson; C. Corcoran; M. C. Norton; J. C. S. Breitner; K. W. Piercy; M. S. DeBerard; D. Stein; B. Foley; K. A. Welsh-Bohmer; A. Frye; C. G. Lyketsos; J. T. Tschanz
err分享
err收藏
Creation and Measurement of a Coherent Superposition of Quantum States
err2003-11-19
err0
PREAI
errFrank Vewinger; Manfred Heinz; Ruth Garcia Fernandez; Nikolay V. Vitanov; Klaas Bergmann
err分享
err收藏
Efficient graph-based image segmentation
err2004-09-01
err4.9K
PREAI
errFelzenszwalb, PF; Huttenlocher, DP
err分享
err收藏
err分享
err收藏
学者 查看更多内容