返回
Unsupervised feature extraction with autoencoder trees
DOI:10.1016/j.neucom.2017.02.075.png)
摘要
En 中文
The autoencoder is a popular neural network model that learns hidden representations of unlabeled data. Typically, single- or multilayer perceptrons are used in constructing an autoencoder, but we use soft decision trees (i.e., hierarchical mixture of experts) instead. Such trees have internal nodes that implement soft multivariate splits through a gating function and all leaves are weighted by the gating values on their path to get the output. The encoder tree converts the input to a lower dimensional representation in its leaves, which it passes to the decoder tree that reconstructs the original input. Because the splits are soft, the encoder and decoder trees can be trained back to back with stochastic gradient-descent to minimize reconstruction error. In our experiments on handwritten digits, newsgroup posts, and images, we observe that the autoencoder trees yield as small and sometimes smaller reconstruction error when compared with autoencoder perceptrons. One advantage of the tree is that it learns a hierarchical representation at different resolutions at its different levels and the leaves specialize at different local regions in the input space. An extension with locally linear mappings in the leaves allows a more flexible model. We also show that the autoencoder tree can be used with multimodal data where a mapping from one modality (i.e., image) to another (i.e., topics) can be learned. (C) 2017 Elsevier B.V. All rights reserved.
Keyword:
Unsupervised learning
Decision trees
Autoencoders
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.5
论文数:
2.5W
被引数:
6.5W
机构
引用论文
Improved Particle Size Control for the Dispersion Polymerization of Methyl methacrylate in Supercritical Carbon Dioxide超临界二氧化碳中甲基丙烯酸甲酯分散聚合的改进粒度控制
Phase Equilibria of Semiclathrate Hydrates of CO2, N2, CH4, or H2+ Tetra-n-butylammonium Bromide Aqueous SolutionPhase Equilibria of Semiclathrate Hydrates of CO2, N2, CH4,或H2 四-n-丁基溴化铵水溶液
Hyaluronic Acid-Based Nanomotors: Crossing Mucosal Barriers to Tackle Antimicrobial Resistance透明质酸基纳米马达:穿越黏膜屏障以应对抗菌耐药性
没有更多内容

