.png){kind=icon}
返回
Two-layer contractive encodings for learning stable nonlinear features
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2014.09.008.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Unsupervised learning of feature hierarchies is often a good strategy to initialize deep architectures for supervised learning. Most existing deep learning methods build these feature hierarchies layer by layer in a greedy fashion using either auto-encoders or restricted Boltzmann machines. Both yield encoders which compute linear projections of input followed by a smooth thresholding function. In this work, we demonstrate that these encoders fail to find stable features when the required computation is in the exclusive-or class. To overcome this limitation, we propose a two-layer encoder which is less restricted in the type of features it can learn. The proposed encoder is regularized by an extension of previous work on contractive regularization. This proposed two-layer contractive encoder potentially poses a more difficult optimization problem, and we further propose to linearly transform hidden neurons of the encoder to make learning easier. We demonstrate the advantages of the two-layer encoders qualitatively on artificially constructed datasets as well as commonly used benchmark datasets. We also conduct experiments on a semi-supervised learning task and show the benefits of the proposed two-layer encoders trained with the linear transformation of perceptrons. (C) 2014 Elsevier Ltd. All rights reserved.
Keyword:
Deep learning
Multi-layer perceptron
Two-layer contractive encoding
Linear transformation
Pretraining
Semi-supervised learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
6.3
论文数:
8.2K
被引数:
3.0W
机构
引用论文
Improved Particle Size Control for the Dispersion Polymerization of Methyl methacrylate in Supercritical Carbon Dioxide超临界二氧化碳中甲基丙烯酸甲酯分散聚合的改进粒度控制
OAAI
OAAI分享收藏Cross-linkable Polymer Matrix for Enhanced Thermal Stability of Succinonitrile-based Polymer Electrolyte in Lithium Rechargeable Batteries可交联聚合物基质，用于增强锂可充电电池中基于丁二腈的聚合物电解质的热稳定性
OAAI
OAAI分享收藏Chiral Co(iii)–salen complex supported over highly ordered functionalized mesoporous silica for enantioselective aminolysis of racemic epoxides手性Co(iii)-salen络合物负载在高度有序的功能化介孔二氧化硅上，用于外消旋环氧化物的对映选择性氨解.png)
RSC Advances
RSC AdvancesIF0
PREAI
分享收藏 没有更多内容
没有更多内容