arrow
Return

Transformations in variational Bayesian factor analysis to speed up learning

delete2010-03-01
delete18
PRE
AI
J
Jaakko Luttinen *
A
Alexander Ilin
DOI:10.1016/j.neucom.2009.11.018delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose simple transformation of the hidden states in variational Bayesian factor analysis models to speed up the learning procedure. The speed-up is achieved by using proper parameterization of the posterior approximation which allows joint optimization of its individual factors, thus the transformation is theoretically justified. We derive the transformation formulae for variational Bayesian factor analysis and show experimentally that it can significantly improve the rate of convergence. The proposed transformation basically performs centering and whitening of the hidden factors taking into account the posterior uncertainties. Similar transformations can be applied to other variational Bayesian factor analysis models as well. (C) 2010 Elsevier B.V. All rights reserved.
Keywords:
Principal component analysis
Factor analysis
Variational Bayesian learning
Subspace rotation
Speed-up
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

A
Aalto University
Scholars:
1.6W
Papers: 1.5W
Citations: 2.1W