.png){kind=icon}
返回
Neuron importance-aware coverage analysis for deep neural network testing
.png){kind=icon}
PRE
AI
DOI：10.1007/s10664-024-10524-x.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Deep Neural Network (DNN) models are widely used in many cutting-edge domains, such as medical diagnostics and autonomous driving. However, an urgent need to test DNN models thoroughly has increasingly risen. Recent research proposes various structural and non-structural coverage criteria to measure test adequacy. Structural coverage criteria quantify the degree to which the internal elements of DNN models are covered by a test suite. However, they convey little information about individual inputs and exhibit limited correlation with defect detection. Additionally, existing non-structural coverage criteria are unaware of neurons' importance to decision-making. This paper addresses these limitations by proposing novel non-structural coverage criteria. By tracing neurons' cumulative contribution to the final decision on the training set, this paper identifies important neurons of DNN models. A novel metric is proposed to quantify the difference in important neuron behavior between a test input and the training set, which provides a measured way at individual test input granularity. Additionally, two non-structural coverage criteria are introduced that allow for the quantification of test adequacy by examining differences in important neuron behavior between the testing and the training set. The empirical evaluation of image datasets demonstrates that the proposed metric outperforms the existing non-structural adequacy metrics by up to 14.7% accuracy improvement in capturing error-revealing test inputs. Compared with state-of-the-art coverage criteria, the proposed coverage criteria are more sensitive to errors, including natural errors and adversarial examples.
Keyword:
Deep neural network testing
Test adequacy
Testing coverage criteria
Non-structural coverage
期刊
IF:
3.6
论文数:
2.0K
被引数:
5.3K
机构
暂无机构信息
引用论文
.png){kind=icon}
NPC: Neuron Path Coverage via Characterizing Decision Logic of Deep Neural NetworksNPC: 通过表征深度神经网络的决策逻辑实现神经元路径覆盖
OAAI
OAAI分享收藏Welding characteristics of aluminum, copper, nickel and aluminum alloy with alumina coating using ultrasonic complex vibration welding equipments铝、铜、镍及铝合金氧化铝涂层超声复合振动焊接特性研究
PREAI
分享收藏分享收藏Thermal expansions of Ln2Zr2O7 (Ln = La, Nd, Sm, and Gd) pyrochloreLn2Zr2O7 (ln = La，Nd，Sm和Gd) 烧绿石的热膨胀
PREAI
分享收藏分享收藏
查看更多内容