arrow
返回

GIST: Generated Inputs Sets Transferability in Deep Learning

delete2024-12-03
delete0
delete
OA
AI
F
Florian Tambon *
F
Foutse Khomh
G
Giuliano Antoniol
DOI:10.1145/3672457delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
To foster the verifiability and testability of deep neural networks (DNN), an increasing number of methods for test case generation techniques are being developed. When confronted with testing DNN models, the user can apply any existing test generation technique. However, it needs to do so for each technique and each DNN model under test, which can be expensive. Therefore, a paradigm shift could benefit this testing process: rather than regenerating the test set independently for each DNN model under test, we could transfer from existing DNN models. This article introduces Generated Inputs Sets Transferability (GIST), a novel approach for the efficient transfer of test sets. Given a property selected by a user (e.g., neurons covered, faults), GIST enables the selection of good test sets from the point of view of this property among available test sets. This allows the user to recover similar properties on the transferred test sets as he would have obtained by generating the test set from scratch with a test cases generation technique. Experimental results show that GIST can select effective test sets for the given property to transfer. Moreover, GIST scales better than reapplying test case generation techniques from scratch on DNN models under test.
Keyword:
Test sets generation
deep learning
DNN
testing
transferability

期刊

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
论文数:
1.2K
被引数:
3.4K

机构

U
universite de montreal
学者数:
4.6W
论文数: 3.8W
被引数: 46
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
err分享
err收藏
QuoTe: Quality-oriented Testing for Deep Learning SystemsQuoTe: 面向质量的深度学习系统测试
err2023-07-22
err3
errOAAI
errChen, Jialuo; Wang, Jingyi; Ma, Xingjun; Sun, Youcheng; Sun, Jun; Zhang, Peixin; Cheng, Peng
err分享
err收藏
学者 查看更多内容