arrow
返回

Understanding contributing neurons via attribution visualization

delete2023-09-01
delete0
PRE
AI
石睿 封面图
石睿 (Rui Shi)
T
Tianxing Li
Y
Yasushi Yamaguchi *
DOI:10.1016/j.neucom.2023.126492delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Understanding contributing neuron features is crucial to explaining convolutional neural network (CNN) decisions. The attribution research provides an effective way to detect contributing neuron features and numerically assign them attribution scores. However, a method to clearly and intuitively represent the implications hidden in neuron attributions is lacking. Attribution scores show the numerical importance of contributing neurons, but the meanings implied by these numerical scores are still not available. To mitigate this gap, we propose an optimization-based visualization method named attribution visualiza-tion, which enables an intuitive understanding of neuron attributions. Our approach is distinguished from existing visualization methods by its ability to produce noise-free result, i.e., the ability to remove irrelevant regions from visualizations. We achieve this by introducing an optimizable mask into the visu-alization process and designing an objective function that simultaneously optimizes the area-constrained mask and visualization. Furthermore, we propose the fractal noise pyramid with diverse and natural fre-quency spectra as our mask perturbation technique which is key to removing unrelated noise in visual-ization. We implement several comparisons and user studies with other visual explanations to demonstrate the unique properties of our attribution visualization. We also apply our attribution visual-ization on two representative CNNs, showcasing its ability to intuitively understand contributing neuron features.& COPY; 2023 Elsevier B.V. All rights reserved.
Keyword:
Convolutional neural network
Feature visualization
Feature semantics

期刊

Neurocomputing 封面图
Neurocomputing
IF:
6.5
论文数:
2.5W
被引数:
6.5W

机构

U
University of Tokyo
学者数:
7.1W
论文数: 6.5W
被引数: 2.2K
B
Beijing University of Technology
学者数:
2.8W
论文数: 2.1W
被引数: 2.7W
引用论文

引用论文

Conservative upper limits on WIMP annihilation cross section from Fermi-LATγrays
err2012-01-18
err0
errOAAI
errFrancesca Calore; Valentina De Romeri; Fiorenza Donato
err分享
err收藏
err分享
err收藏
Explaining a series of models by propagating Shapley values
err2022-08-03
err61
errOAAI
errChen, Hugh; Lundberg, Scott M.; Lee, Su-In
err分享
err收藏
Output-targeted baseline for neuron attribution calculation
err2022-08-01
err5
errOAAI
errShi, Rui; Li, Tianxing; Yamaguchi, Yasushi
err分享
err收藏
学者 查看更多内容