.png){kind=icon}
返回
Using metamorphic relations to verify and enhance Artcode classification
.png){kind=icon}
OA
AI
DOI：10.1016/j.jss.2021.111060.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Software testing is often hindered where it is impossible or impractical to determine the correctness of the behaviour or output of the software under test (SUT), a situation known as the oracle problem. An example of an area facing the oracle problem is automatic image classification, using machine learning to classify an input image as one of a set of predefined classes. An approach to software testing that alleviates the oracle problem is metamorphic testing (MT). While traditional software testing examines the correctness of individual test cases, MT instead examines the relations amongst multiple executions of test cases and their outputs. These relations are called metamorphic relations (MRs): if an MR is found to be violated, then a fault must exist in the SUT. This paper examines the problem of classifying images containing visually hidden markers called Artcodes, and applies MT to verify and enhance the trained classifiers. This paper further examines two MRs, Separation and Occlusion, and reports on their capability in verifying the image classification using one-way analysis of variance (ANOVA) in conjunction with three other statistical analysis methods: t-test (for unequal variances), Kruskal-Wallis test, and Dunnett's test. In addition to our previously-studied classifier, that used Random Forests, we introduce a new classifier that uses a support vector machine, and present its MR-augmented version. Experimental evaluations across a number of performance metrics show that the augmented classifiers can achieve better performance than non-augmented classifiers. This paper also analyses how the enhanced performance is obtained. (C) 2021 Elsevier Inc. All rights reserved.
Keyword:
Metamorphic testing
Metamorphic relation
Classification
Software verification
Machine learning
Artcode
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
4.1
论文数:
5.5K
被引数:
8.4K
机构
引用论文
.png){kind=icon}
分享收藏SBA-15:TiO2 nanocomposites: II. Direct and post-synthesis using acetylacetoneSBA-15:TiO2纳米复合材料: II。使用乙酰丙酮的直接和后合成
PREAI
分享收藏
Metamorphic Testing for Software Quality Assessment: A Study of Search Engines用于软件质量评估的变形测试: 搜索引擎的研究
PREAI
分享收藏
查看更多内容