arrow
返回

Mutation testing of unsupervised learning systems

delete2024-01-01
delete1
PRE
AI
Y
Yuteng Lu
K
Kaicheng Shao
J
Jia Zhao
W
Weidi Sun
M
Meng Sun *
DOI:10.1016/j.sysarc.2023.103050delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Unsupervised learning (UL) is one of the most important areas in artificial intelligence. UL systems are capable of learning patterns from unlabeled data and playing an increasingly critical role in many fields. Therefore, more and more attention has been paid to the security and stability of UL systems. Testing has achieved great success in ensuring the safety of traditional software systems and been gradually applied to supervised learning. However, UL is not in the consideration of most current testing methods. To fill this gap, we propose a novel mutation testing technique specific to UL systems. We design a series of mutation operators to simulate the unstable situations and possible errors that UL systems may encounter, and define corresponding mutation scores. Further, we combine the proposed technique with autoencoder for generating adversarial samples. In the evaluation phase, we demonstrate the practicability of the proposed technique based on three datasets. We have also developed an open-source tool MTGAN, which incorporates the functionality of mutation testing for GANs, to evaluate their stability and assess their capacity to address given issues.
Keyword:
Mutation testing
Unsupervised learning
Cluster analysis
Autoencoder

期刊

Journal of Systems Architecture 封面图
Journal of Systems Architecture
IF:
4.1
论文数:
3.0K
被引数:
4.2K

机构

C
Changchun Institute Technology
学者数:
691
论文数: 440
被引数: 12
P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
引用论文

引用论文

Dimorphic study of surgical anatomic landmarks of the lateral ramus of the mandible
err1993-04-01
err0
PREAI
errChristopher H. Martone; Avital Mazar Ben-Josef; Steven M. Wolf; Sheldon M. Mintz
err分享
err收藏
err分享
err收藏
Application of Probiotics for the Production of Safe and High-quality Poultry Meat
err2016-10-31
err0
errOAAI
errYong Ha Park; Farizal Hamidon; Chandraprasad Rajangan; Kim Pong Soh; Chee Yuen Gan; Theam Soon Lim; Wan Nadiah Wan Abdullah; Min Tze Liong
err分享
err收藏
err分享
err收藏
学者 查看更多内容