arrow
返回

A Novel Deep Density Model for Unsupervised Learning

delete2018-06-25
delete15
PRE
AI
X
Xi Yang
K
Kaizhu Huang *
R
Rui Zhang
J
John Y. Goulermas
DOI:10.1007/s12559-018-9566-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Density models are fundamental in machine learning and have received a widespread application in practical cognitive modeling tasks and learning problems. In this work, we introduce a novel deep density model, referred to as deep mixtures of factor analyzers with common loadings (DMCFA), with an efficient greedy layer-wise unsupervised learning algorithm. The model employs a mixture of factor analyzers sharing common component loadings in each layer. The common loadings can be considered to be a feature selection or reduction matrix which makes this new model more physically meaningful. Importantly, sharing common components is capable of reducing both the number of free parameters and computation complexity remarkably. Consequently, DMCFA makes inference and learning rely on a dramatically more succinct model and avoids sacrificing its flexibility in estimating the data density by utilizing Gaussian distributions as the priors. Our model is evaluated on five real datasets and compared to three other competitive models including mixtures of factor analyzers (MFA), MFA with common loadings (MCFA), deep mixtures of factor analyzers (DMFA), and their collapsed counterparts. The results demonstrate the superiority of the proposed model in the tasks of density estimation, clustering, and generation.
Keyword:
Deep density model
Mixtures of factor analyzers
Common component factor loadings
Dimensionality reduction
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Cognitive Computation 封面图
Cognitive Computation
IF:
4.3
论文数:
1.6K
被引数:
3.6K

机构

U
University of Liverpool
学者数:
2.8W
论文数: 2.5W
被引数: 3.5W
引用论文

引用论文

err分享
err收藏
学者 查看更多内容