arrow
Return

Autoencoder node saliency: Selecting relevant latent representations

delete2019-04-01
delete23
delete
OA
AI
Y
Ya Ju Fan *
DOI:10.1016/j.patcog.2018.12.015delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The autoencoder is an artificial neural network that performs nonlinear dimension reduction and learns hidden representations of unlabeled data. With a linear transfer function it is similar to the principal component analysis (PCA). While both methods use weight vectors for linear transformations, the autoencoder does not come with any indication similar to the eigenvalues in PCA that are paired with eigenvectors. We propose a novel autoencoder node saliency method that examines whether the features constructed by autoencoders exhibit properties related to known class labels. The supervised node saliency ranks the nodes based on their capability of performing a learning task. It is coupled with the normalized entropy difference (NED). We establish a property for NED values to verify classifying behaviors among the top ranked nodes. By applying our methods to real datasets, we demonstrate their ability to provide indications on the performing nodes and explain the learned tasks in autoencoders. (C) 2018 Elsevier Ltd. All rights reserved.
Keywords:
Autoencoder
Latent representations
Unsupervised learning
Neural networks
Node selection
Model interpretation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
Cited Papers

Cited Papers

Search-coil head-thrust and caloric tests in Ménière's disease
err2009-07-08
err0
errOAAI
errHong Ju Park; Americo A. Migliaccio; Charley C. Della Santina; Lloyd B. Minor; John P. Carey
errShare
errSave
errShare
errSave
Carbon-dot-encapsulated molecularly imprinted mesoporous organosilica for fluorescent sensing of rhodamine 6G
err2018-01-19
err0
PREAI
errChuanfeng Cui; Juying Lei; Lingang Yang; Bin Shen; Lingzhi Wang; Jinlong Zhang
errShare
errSave
A trainable feature extractor for handwritten digit recognition
err2007-06-01
err195
errOAAI
errLauer, Fabien; Suen, Ching Y.; Bloch, Gerard
errShare
errSave
Gradient-based learning applied to document recognition
err1998-01-01
err3.8W
PREAI
errLecun, Y; Bottou, L; Bengio, Y; Haffner, P
errShare
errSave
errShare
errSave
errShare
errSave
researcher View more