返回
Mutation testing of unsupervised learning systems
DOI:10.1016/j.sysarc.2023.103050.png)
摘要
En 中文
Unsupervised learning (UL) is one of the most important areas in artificial intelligence. UL systems are capable of learning patterns from unlabeled data and playing an increasingly critical role in many fields. Therefore, more and more attention has been paid to the security and stability of UL systems. Testing has achieved great success in ensuring the safety of traditional software systems and been gradually applied to supervised learning. However, UL is not in the consideration of most current testing methods. To fill this gap, we propose a novel mutation testing technique specific to UL systems. We design a series of mutation operators to simulate the unstable situations and possible errors that UL systems may encounter, and define corresponding mutation scores. Further, we combine the proposed technique with autoencoder for generating adversarial samples. In the evaluation phase, we demonstrate the practicability of the proposed technique based on three datasets. We have also developed an open-source tool MTGAN, which incorporates the functionality of mutation testing for GANs, to evaluate their stability and assess their capacity to address given issues.
Keyword:
Mutation testing
Unsupervised learning
Cluster analysis
Autoencoder
期刊
IF:
4.1
论文数:
3.0K
被引数:
4.2K
机构
引用论文
Adaptation of the IEC 61000-4-7 Measurement Method to CISPR Band A (9-150 kHz)IEC 61000测量方法对CISPR频段A (9-150 kHz) 的适应性
METTLE: A METamorphic Testing Approach to Assessing and Validating Unsupervised Machine Learning SystemsMETTLE: 一种评估和验证无监督机器学习系统的变质测试方法
Low-Complexity Non-Intrusive Load Monitoring Using Unsupervised Learning and Generalized Appliance Models使用无监督学习和广义设备模型的低复杂度非侵入式负载监控

