arrow
返回

DeepMC: DNN test sample optimization method jointly guided by misclassification and coverage

delete2022-11-28
delete2
PRE
AI
J
Jiaze Sun
李娟 封面图
李娟 (Juan Li) *
S
Sulei Wen
DOI:10.1007/s10489-022-04323-4delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Large-scale and high-quality test samples are extremely scarce in deep neural networks(DNN) testing. Existing test sample optimization methods exhibit the problem of low efficiency and low neuron coverage of optimized test samples, which consistently fail to expose erroneous behaviors of DNNs with corner-case inputs. In this paper, we propose DeepMC, an image classification DNN test sample optimization method jointly guided by misclassification and coverage. Specifically, we select the seed sample from the original test samples according to the misclassification probability. To maximize the misclassification probability and neuron coverage, we construct the joint optimization problem for the seed samples and use the gradient ascent to solve the joint optimization problem. We evaluate this method on two well-known datasets and prevalent image classification DNN models. Compare with DeepXplore, a DL white-box testing framework, DeepMC does not require multiple DNN models with similar functions for cross-referencing, saves 90% time consumption on MNIST, averagely covers 1.87% more neurons, and optimized test samples with more than 69% attack success rate. In addition, the test sample optimized by DeepMC can also be applied to optimize the robustness of the corresponding DNN with an average 3% improvement of the model's accuracy.
Keyword:
Deep neural networks
Testing
Neuron coverage
Misclassification probability
Test sample optimization
Image classification

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

暂无机构信息
引用论文

引用论文

Sexual segregation in red deer: is social behaviour more important than habitat preferences?
err2013-02-01
err0
PREAI
errJoana Alves; António Alves da Silva; Amadeu M.V.M. Soares; Carlos Fonseca
err分享
err收藏
Adversarial Examples on Object Recognition: A Comprehensive Survey
err2020-06-12
err90
errOAAI
errSerban, Alex; Poll, Erik; Visser, Joost
err分享
err收藏
err分享
err收藏
Transferable adversarial examples can efficiently fool topic models
err2022-07-01
err6
PREAI
errWang, Zhen; Zheng, Yitao; Zhu, Hai; Yang, Chang; Chen, Tianyi
err分享
err收藏
err分享
err收藏
学者 查看更多内容