arrow
返回

Activation-Based Cause Analysis Method for Neural Networks

delete2021-01-01
delete0
delete
OA
AI
Y
Yong Gyun Kim
H
Hyung Il Koo *
DOI:10.1109/ACCESS.2021.3103322delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
As neural networks are ubiquitous in the real-world environment, we encounter a variety of situations in which neural network-based systems fail. To address these failures, we need to identify their root causes. However, due to the black-box nature of neural networks, it is considered a difficult task to explain/understand internal functions, and cause analysis is usually conducted based on personal experience. To alleviate these problems, we propose a method to compute an element-wise contribution of inputs on current decisions. To this end, we focus on the physical meaning of neuron activations, and formulate an optimization problem that finds partial activations that support current decisions. Then, by accumulating these partial activations in the backward direction, we evaluate the contributions of each element in an input vector to the current decision. Experimental results have shown that the proposed method outperforms conventional methods in terms of cause localization for a range of failure scenarios.
Keyword:
Perturbation methods
Neurons
Biological neural networks
Visualization
Licenses
Computational modeling
Training
Multilayer perceptron
interpretable machine learning
explaining classification
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

A
Ajou University
学者数:
1.1W
论文数: 1.0W
被引数: 8.9K
引用论文

引用论文

err分享
err收藏
Fuzziness-based online sequential extreme learning machine for classification problems
err2018-02-07
err25
PREAI
errCao, Weipeng; Gao, Jinzhu; Ming, Zhong; Cai, Shubin; Shan, Zhiguang
err分享
err收藏
Subsequent Pain or Injury After Foot and Ankle Surgery in Patients Receiving Workers’ Compensation
err2019-10-25
err0
errOAAI
errGabrielle Bui; Yubo Gao; Natalie Glass; Christopher Cychosz; John Lawrence Marsh; Phinit Phisitkul
err分享
err收藏
Chemical characterization of leptin-activated neurons in the rat brain
err2000-01-01
err0
PREAI
errCarol F. Elias; Joseph F. Kelly; Charlotte E. Lee; Rexford S. Ahima; Daniel J. Drucker; Clifford B. Saper; Joel K. Elmquist
err分享
err收藏
学者 查看更多内容