.png){kind=icon}
返回
Efficient and Effective Feature Space Exploration for Testing Deep Learning Systems
.png){kind=icon}
OA
AI
DOI：10.1145/3544792.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Assessingthe quality of Deep Learning (DL) systems is crucial, as they are increasingly adopted in safetycritical domains. Researchers have proposed several input generation techniques for DL systems. While such techniques can expose failures, they do not explain which features of the test inputs influenced the system's (mis-) behaviour. DeepHyperion was the first test generator to overcome this limitation by exploring the DL systems' feature space at large. In this article, we propose DeepHyperion-CS, a test generator for DL systems that enhances DeepHyperion by promoting the inputs that contributed more to feature space exploration during the previous search iterations. We performed an empirical study involving two different test subjects (i.e., a digit classifier and a lane-keeping system for self-driving cars). Our results proved that the contribution-based guidance implemented within DeepHyperion-CS outperforms state-of-the-art tools and significantly improves the efficiency and the effectiveness of DeepHyperion. DeepHyperion-CS exposed significantly more misbehaviours for five out of six feature combinations and was up to 65% more efficient than DeepHyperion in finding misbehaviour-inducing inputs and exploring the feature space. DeepHyperion-CS was useful for expanding the datasets used to train the DL systems, populating up to 200% more feature map cells than the original training set.
Keyword:
Software testing
Deep Learning
search based software engineering
self-driving cars
期刊
A
IF:
6.2
论文数:
1.2K
被引数:
3.4K
机构
引用论文
.png){kind=icon}
Molecular motion in plastic phases of organometallic compounds: iron-57 Mössbauer and carbon-13 n.m.r. spectra of tricarbonyl(1–5-hapto-cyclohexadienyl)iron tetrafluoroborate and related compounds有机金属化合物的塑料相中的分子运动: 铁-57 m ö ssbauer和碳-13 n.m.r.三羰基 (1-5-半环己二烯基) 四氟硼酸铁和相关化合物的光谱
PREAI
分享收藏Association of vitamin D receptor gene polymorphism with the risk of systemic lupus erythematosus维生素d受体基因多态性与系统性红斑狼疮发病风险的相关性研究
PREAI
分享收藏
分享收藏A Theoretical and Empirical Study of Search-Based Testing: Local, Global, and Hybrid Search基于搜索的测试的理论和实证研究: 本地，全局和混合搜索
PREAI
分享收藏
查看更多内容