返回
Diversified feature representation via deep auto-encoder ensemble through multiple activation functions
DOI:10.1007/s10489-021-03054-2.png)
摘要
En 中文
In this paper, we propose a novel Deep Auto-Encoders Ensemble model (DAEE) through assembling multiple deep network models with different activation functions. The hidden features obtained by our proposed model have better robustness in representation than traditional variants of auto-encoders because it aggregates the diversified feature representations from multiple activation sub-networks into a more robust uniform feature representations. In order to obtain such uniform feature representations, we set the weight of each individual auto-encoder sub-network by optimizing the cost function over multiple auto-encoder sub-networks in the proposed model. Therefore, decreases the influence of individual sub-networks with improper activations and increase those with appropriate activations, to ensure the final feature representation to keep more predominant and comprehensive feature information. Extensive experiments on benchmark computer vision datasets, including MNIST, COIL-20, CIFAR-10 and SVHN, demonstrate the superiority of our proposed method among state-of-the-art auto-encoder methods, such as sparse auto-encoders (SAE), denoising auto-encoders (DAE), stacked denoising auto-encoders (SDAE) and graph regularized auto-encoders (GAE).
Keyword:
Auto-encoders
Feature representation
Sub-network
Ensemble model
期刊
IF:
3.5
论文数:
7.6K
被引数:
1.7W
机构
引用论文
Extracting and inserting knowledge into stacked denoising auto-encoders提取知识并将其插入到堆叠的去噪自动编码器中
NEURAL NETWORKS
IF6.3
A sparse auto-encoder-based deep neural network approach for induction motor faults classification
MEASUREMENT
IF5.6
A novel robust ensemble model integrated extreme learning machine with multi-activation functions for energy modeling and analysis: Application to petrochemical industry
ENERGY
IF9.4

