arrow
Return

GenMorph: Automatically Generating Metamorphic Relations via Genetic Programming

delete2024-07-01
delete2
delete
OA
AI
J
Jon Ayerdi *
V
Valerio Terragni
G
Gunel Jahangirova
A
Aitor Arrieta
P
Paolo Tonella
DOI:10.1109/TSE.2024.3407840delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Metamorphic testing is a popular approach that aims to alleviate the oracle problem in software testing. At the core of this approach are Metamorphic Relations (MRs), specifying properties that hold among multiple test inputs and corresponding outputs. Deriving MRs is mostly a manual activity, since their automated generation is a challenging and largely unexplored problem. This paper presents GenMorph, a technique to automatically generate MRs for Java methods that involve inputs and outputs that are boolean, numerical, or ordered sequences. GenMorph uses an evolutionary algorithm to search for effective test oracles, i.e., oracles that trigger no false alarms and expose software faults in the method under test. The proposed search algorithm is guided by two fitness functions that measure the number of false alarms and the number of missed faults for the generated MRs. Our results show that GenMorph generates effective MRs for 18 out of 23 methods (mutation score > 20%). Furthermore, it can increase Randoop's fault detection capability in 7 out of 23 methods, and Evosuite's in 14 out of 23 methods. When compared with AutoMR, a state-of-the-art MR generator, GenMorph also outperformed its fault detection capability in 9 out of 10 methods.
Keywords:
Testing
Java
Generators
Space exploration
Manuals
Genetic programming
Filters
Metamorphic testing
oracle problem
metamorphic relations
genetic programming
mutation analysis

Journal

IEEE Transactions on Software Engineering cover
IEEE Transactions on Software Engineering
IF:
5.6
Papers:
2.9K
Citations:
1.1W

Organization

M
mondragon unibertsitatea
Scholars:
1.2K
Papers: 767
Citations: 4
U
University of Auckland
Scholars:
2.3W
Papers: 2.4W
Citations: 3.3W
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305
researcher View more organizations
Cited Papers

Cited Papers

Differential dynamics of donor DC and non-DC peripheral blood mononuclear cell microchimerism in lung transplantation
err2009-11-01
err0
PREAI
errJoel Van der Meulen; Nicole A. Mifsud; Diahnn Abud; Eldho Paul; Michael D. Varney; Sharon R. Lewin; Paul U. Cameron; Tom C. Kotsimbos
errShare
errSave
Effect of oral nitrates on pulse pressure and arterial elasticity in patients aged over 65 years with refractory isolated systolic hypertension: study protocol for a randomized controlled trial
err2013-01-01
err0
errOAAI
errDaniel Abad-Pérez; Blanca Novella-Arribas; Francisco J Rodríguez-Salvanés; Luis M Sánchez-Gómez; Iluminada García-Polo; Carmen Verge-González; Carmen Suárez-Fernández
errShare
errSave
NICE guidance
err2009-05-01
err0
PREAI
errTina Bishop
errShare
errSave
Metamorphic Relations for Enhancing System Understanding and Use
err2020-10-01
err89
errOAAI
errZhou, Zhi Quan; Sun, Liqun; Chen, Tsong Yueh; Towey, Dave
errShare
errSave
Effect of Blade Thickness on Internal Flow and Performance of a Plastic Centrifugal Pump
err2022-01-14
err0
errOAAI
errZhenfa Xu; Fanyu Kong; Lingfeng Tang; Mingwei Liu; Jiaqiong Wang; Ning Qiu
errShare
errSave
researcher View more