arrow
Return

Variational Bayesian sparse additive matrix factorization

delete2013-05-04
delete13
delete
OA
AI
S
Shinichi Nakajima *
M
Masashi Sugiyama
S
S. Derin Babacan
DOI:10.1007/s10994-013-5347-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Principal component analysis (PCA) approximates a data matrix with a low-rank one by imposing sparsity on its singular values. Its robust variant can cope with spiky noise by introducing an element-wise sparse term. In this paper, we extend such sparse matrix learning methods, and propose a novel framework called sparse additive matrix factorization (SAMF). SAMF systematically induces various types of sparsity by a Bayesian regularization effect, called model-induced regularization. Although group LASSO also allows us to design arbitrary types of sparsity on a matrix, SAMF, which is based on the Bayesian framework, provides inference without any requirement for manual parameter tuning. We propose an efficient iterative algorithm called the mean update (MU) for the variational Bayesian approximation to SAMF, which gives the global optimal solution for a large subset of parameters in each step. We demonstrate the usefulness of our method on benchmark datasets and a foreground/background video separation problem.
Keywords:
Variational Bayes
Robust PCA
Matrix factorization
Sparsity
Model-induced regularization

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

I
Institute of Science Tokyo
Scholars:
3.2W
Papers: 2.7W
Citations: 117
T
Tokyo Institute of Technology
Scholars:
1.1W
Papers: 9.0K
Citations: 1.9W
N
nikon corporation
Scholars:
139
Papers: 88
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Bayesian Robust Principal Component Analysis
err2011-12-01
err234
errOAAI
errDing, Xinghao; He, Lihan; Carin, Lawrence
errShare
errSave
Social class, parental education, and obesity prevalence in a study of six-year-old children in Germany
err2005-03-15
err0
PREAI
errA Lamerz; J Kuepper-Nybelen; C Wehle; N Bruning; G Trost-Brinkhues; H Brenner; J Hebebrand; B Herpertz-Dahlmann
errShare
errSave
Cognitive Stimulation and Cognitive and Functional Decline in Alzheimer's Disease: The Cache County Dementia Progression Study
err2011-03-25
err0
errOAAI
errK. A. Treiber; M. C. Carlson; C. Corcoran; M. C. Norton; J. C. S. Breitner; K. W. Piercy; M. S. DeBerard; D. Stein; B. Foley; K. A. Welsh-Bohmer; A. Frye; C. G. Lyketsos; J. T. Tschanz
errShare
errSave
Creation and Measurement of a Coherent Superposition of Quantum States
err2003-11-19
err0
PREAI
errFrank Vewinger; Manfred Heinz; Ruth Garcia Fernandez; Nikolay V. Vitanov; Klaas Bergmann
errShare
errSave
Efficient graph-based image segmentation
err2004-09-01
err4.9K
PREAI
errFelzenszwalb, PF; Huttenlocher, DP
errShare
errSave
In-situ IR Spectroscopy to Study Anodic Oxidation of Si(111) in KOH Solution
err2007-04-27
err0
errOAAI
errHarold Philipsen; Jean-Noel Chazalviel; Philippe Allongue; François Ozanam
errShare
errSave
researcher View more