Return
Understanding neural network through neuron level visualization
DOI:10.1016/j.neunet.2023.09.030.png)
Abstract
En 中文
Neurons are the fundamental units of neural networks. In this paper, we propose a method for explaining neural networks by visualizing the learning process of neurons. For a trained neural network, the proposed method obtains the features learned by each neuron and displays the features in a human-understandable form. The features learned by different neurons are combined to analyze the working mechanism of different neural network models. The method is applicable to neural networks without requiring any changes to the architectures of the models. In this study, we apply the proposed method to both Fully Connected Networks (FCNs) and Convolutional Neural Networks (CNNs) trained using the backpropagation learning algorithm. We conduct experiments on models for image classification tasks to demonstrate the effectiveness of the method. Through these experiments, we gain insights into the working mechanisms of various neural network architectures and evaluate neural network interpretability from diverse perspectives.
Keywords:
Interpretability
Neural network
Visualization
Journal
IF:
6.3
Papers:
8.3K
Citations:
3.0W
Organization
Cited Papers
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
PROCEEDINGS OF THE IEEE
IF25.9
Interpretable learning based Dynamic Graph Convolutional Networks for Alzheimer's Disease analysis
INFORMATION FUSION
IF15.5
Explaining the black-box model: A survey of local interpretation methods for deep neural networks
NEUROCOMPUTING
IF6.5
Trend Analysis on Adoption of Virtual and Augmented Reality in the Architecture, Engineering, and Construction Industry
Data
IF0

