arrow
Return

Feedback-Directed Metamorphic Testing

delete2023-02-13
delete5
PRE
AI
孙
孙昌爱 (Chang‐ai Sun) *
H
Hepeng Dai
H
Huai Liu
T
Tsong Yueh Chen
DOI:10.1145/3533314delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Over the past decade, metamorphic testing has gained rapidly increasing attention from both academia and industry, particularly thanks to its high efficacy on revealing real-life software faults in a wide variety of application domains. On the basis of a set of metamorphic relations among multiple software inputs and their expected outputs, metamorphic testing not only provides a test case generation strategy by constructing new (or follow-up) test cases from some original (or source) test cases, but also a test result verificationmechanism through checking the relationship between the outputs of source and follow-up test cases. Many efforts have been made to further improve the cost-effectiveness ofmetamorphic testing from different perspectives. Some studies attempted to identify good metamorphic relations, while other studies were focused on applying effective test case generation strategies especially for source test cases. In this article, we propose improving the cost-effectiveness of metamorphic testing by leveraging the feedback information obtained in the test execution process. Consequently, we develop a new approach, namely feedback-directed metamorphic testing, which makes use of test execution information to dynamically adjust the selection of metamorphic relations and selection of source test cases. We conduct an empirical study to evaluate the proposed approach based on four laboratory programs, one GNU program, and one industry program. The empirical results show that feedback-directed metamorphic testing can use fewer test cases and take less time than the traditional metamorphic testing for detecting the same number of faults. It is clearly demonstrated that the use of feedback information about test execution does help enhance the cost-effectiveness of metamorphic testing. Our work provides a new perspective to improve the efficacy and applicability of metamorphic testing as well as many other software testing techniques.
Keywords:
Metamorphic testing
metamorphic relation
test execution
feedback control
random testing
adaptive partition testing

Journal

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
Papers:
1.2K
Citations:
3.4K

Organization

S
Swinburne University of Technology
Scholars:
9.3K
Papers: 1.2W
Citations: 2.0W
Cited Papers

Cited Papers

Comparison of three methods for cell surface proteome extraction ofListeria monocytogenesbiofilms
err2018-12-01
err0
errOAAI
errJulia Esbelin; Tiago Santos; Céline Ribière; Mickaël Desvaux; Didier Viala; Christophe Chambon; Michel Hébraud
errShare
errSave
Respiring to infect: Emerging links between mitochondria, the electron transport chain, and fungal pathogenesis
err2021-07-08
err0
errOAAI
errBraydon Black; Christopher Lee; Linda C. Horianopoulos; Won Hee Jung; James W. Kronstad
errShare
errSave
Metamorphic Testing of RESTful Web APIs
err2018-11-01
err98
errOAAI
errSegura, Sergio; Parejo, Jose A.; Troya, Javier; Ruiz-Cortes, Antonio
errShare
errSave
Mild hypothermia therapy for patients with severe brain injury
err2002-09-01
err0
PREAI
errRoman Gal; Ivan Cundrle; Iveta Zimova; Martin Smrcka
errShare
errSave
Knowledge and attitudes of school teachers, preschool teachers and students in teacher training about epilepsy and emergency management of seizures
err2015-06-25
err0
PREAI
errHenriette K Dumeier; Martina P Neininger; Matthias K Bernhard; Steffen Syrbe; Andreas Merkenschlager; Jörg Zabel; Wieland Kiess; Thilo Bertsche; Astrid Bertsche
errShare
errSave
Urinary flow curve patterns and their prognostic value in males over the age of 50 years
err2005-10-19
err0
PREAI
errJ. Balslev Jørgensen; P. Klarskov; J. Thorup Andersen; K.M.‐E. Jensen; P. Mogensen
errShare
errSave
Single-system ectopic ureter: a 15-year review
err2001-11-01
err0
PREAI
errS. K. Chowdhary; A. Lander; K. Parashar; J. J. Corkery
errShare
errSave
Machine Learning Testing: Survey, Landscapes and Horizons
err2022-01-01
err441
errOAAI
errZhang, Jie M.; Harman, Mark; Ma, Lei; Liu, Yang
errShare
errSave
errShare
errSave
researcher View more