arrow
Return

Understanding neural network through neuron level visualization

delete2023-11-01
delete8
PRE
AI
窦
窦辉 (Hui Dou)
F
Furao Shen *
赵
赵健 (Jian Zhao) *
X
Xingyu Mu
DOI:10.1016/j.neunet.2023.09.030delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Neurons are the fundamental units of neural networks. In this paper, we propose a method for explaining neural networks by visualizing the learning process of neurons. For a trained neural network, the proposed method obtains the features learned by each neuron and displays the features in a human-understandable form. The features learned by different neurons are combined to analyze the working mechanism of different neural network models. The method is applicable to neural networks without requiring any changes to the architectures of the models. In this study, we apply the proposed method to both Fully Connected Networks (FCNs) and Convolutional Neural Networks (CNNs) trained using the backpropagation learning algorithm. We conduct experiments on models for image classification tasks to demonstrate the effectiveness of the method. Through these experiments, we gain insights into the working mechanisms of various neural network architectures and evaluate neural network interpretability from diverse perspectives.
Keywords:
Interpretability
Neural network
Visualization

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
8.3K
Citations:
3.0W

Organization

N
nanjing university
Scholars:
7.8W
Papers: 5.6W
Citations: 87
Cited Papers

Cited Papers

A decade of tyrosine kinases: from gene discovery to therapeutics
err2003-07-01
err0
PREAI
errRolf J. Craven; Harry Lightfoot; William G. Cance
errShare
errSave
Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications
err2021-03-01
err575
errOAAI
errSamek, Wojciech; Montavon, Gregoire; Lapuschkin, Sebastian; Anders, Christopher J.; Mueller, Klaus-Robert
errShare
errSave
errShare
errSave
errShare
errSave
Herbivory on Zostera marina by the gastropod Smaragdia viridis
err2009-04-01
err0
PREAI
errJosé L. Rueda; Carmen Salas; Javier Urra; Pablo Marina
errShare
errSave
Oxidative stress in liver of grass carp Ctenopharyngodon idella naturally infected with Saprolegnia parasitica and its influence on disease pathogenesis
err2020-01-06
err0
PREAI
errMatheus D. Baldissera; Carine F. Souza; Lorenzo B. Abbad; Maria Izabel U.M. da Rocha; Marcelo L. da Veiga; Aleksandro S. da Silva; Bernardo Baldisserotto
errShare
errSave
Explaining the black-box model: A survey of local interpretation methods for deep neural networks
err2021-01-01
err137
errOAAI
errLiang, Yu; Li, Siguang; Yan, Chungang; Li, Maozhen; Jiang, Changjun
errShare
errSave
errShare
errSave
Trustworthy artificial intelligence
err2020-10-01
err245
errOAAI
errThiebes, Scott; Lins, Sebastian; Sunyaev, Ali
errShare
errSave
researcher View more