arrow
返回

Unsupervised feature extraction with autoencoder trees

delete2017-10-01
delete47
PRE
AI
O
Ozan İrsoy *
E
Ethem Alpaydın
DOI:10.1016/j.neucom.2017.02.075delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The autoencoder is a popular neural network model that learns hidden representations of unlabeled data. Typically, single- or multilayer perceptrons are used in constructing an autoencoder, but we use soft decision trees (i.e., hierarchical mixture of experts) instead. Such trees have internal nodes that implement soft multivariate splits through a gating function and all leaves are weighted by the gating values on their path to get the output. The encoder tree converts the input to a lower dimensional representation in its leaves, which it passes to the decoder tree that reconstructs the original input. Because the splits are soft, the encoder and decoder trees can be trained back to back with stochastic gradient-descent to minimize reconstruction error. In our experiments on handwritten digits, newsgroup posts, and images, we observe that the autoencoder trees yield as small and sometimes smaller reconstruction error when compared with autoencoder perceptrons. One advantage of the tree is that it learns a hierarchical representation at different resolutions at its different levels and the leaves specialize at different local regions in the input space. An extension with locally linear mappings in the leaves allows a more flexible model. We also show that the autoencoder tree can be used with multimodal data where a mapping from one modality (i.e., image) to another (i.e., topics) can be learned. (C) 2017 Elsevier B.V. All rights reserved.
Keyword:
Unsupervised learning
Decision trees
Autoencoders
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

B
Bogazici University
学者数:
4.1K
论文数: 3.9K
被引数: 27
C
Cornell University
学者数:
6.3W
论文数: 5.4W
被引数: 10.9W
引用论文

引用论文

Multimodal Deep Autoencoder for Human Pose Recovery
err2015-12-01
err520
PREAI
errHong, Chaoqun; Yu, Jun; Wan, Jian; Tao, Dacheng; Wang, Meng
err分享
err收藏
Multimodal video classification with stacked contractive autoencoders
err2016-03-01
err104
PREAI
errLiu, Yanan; Feng, Xiaoqing; Zhou, Zhiguang
err分享
err收藏
Semantic hashing
err2009-07-01
err939
errOAAI
errSalakhutdinov, Ruslan; Hinton, Geoffrey
err分享
err收藏
err分享
err收藏
没有更多内容