arrow
Return

Mutation Testing in Practice: Insights From Open-Source Software Developers

delete2024-05-01
delete2
delete
OA
AI
A
Ana B. Sánchez *
J
José Antonio Parejo
S
Sergio Segura
A
Amador Durán
M
Mike Papadakis
DOI:10.1109/TSE.2024.3377378delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Mutation testing drives the creation and improvement of test cases by evaluating their ability to identify synthetic faults. Over the past decades, the technique has gained popularity in academic circles. In practice, however, little is known about its adoption and use. While there are some pilot studies applying mutation testing in industry, the overall usage of mutation testing among developers remains largely unexplored. To fill this gap, this paper presents the results of a qualitative study among open-source developers on the use of mutation testing. Specifically, we report the results of a survey of 104 contributors to open-source projects using a variety of mutation testing tools. The findings of our study provide helpful insights into the use of mutation testing in practice, including its main benefits and limitations. Overall, we observe a high degree of satisfaction with mutation testing across different programming languages and mutation testing tools. Developers find the technique helpful for improving the quality of test suites, detecting bugs, and improving code maintainability. Popularity, usability, and configurability emerge as key factors for the adoption of mutation tools, whereas performance stands overwhelmingly as their main limitation. These results lay the groundwork for new research contributions and tools that meet the needs of developers and boost the widespread adoption of mutation testing.
Keywords:
Mutation testing
mutation tools
qualitative study
GitHub

Journal

IEEE Transactions on Software Engineering cover
IEEE Transactions on Software Engineering
IF:
5.6
Papers:
2.9K
Citations:
1.1W

Organization

U
University of Sevilla
Scholars:
1.9W
Papers: 1.7W
Citations: 15
U
university of luxembourg
Scholars:
5.2K
Papers: 4.8K
Citations: 4
Cited Papers

Cited Papers

Congenital muscular dystrophies in the UK population: Clinical and molecular spectrum of a large cohort diagnosed over a 12-year period
err2017-09-01
err0
PREAI
errMaria Sframeli; Anna Sarkozy; Marta Bertoli; Guja Astrea; Judith Hudson; Mariacristina Scoto; Rachael Mein; Michael Yau; Rahul Phadke; Lucy Feng; Caroline Sewry; Adeline Ngoh Seow Fen; Cheryl Longman; Gary McCullagh; Volker Straub; Stephanie Robb; Adnan Manzur; Kate Bushby; Francesco Muntoni
errShare
errSave
Periarticular liposomal bupivacaine mixture injection vs. single-shot interscalene block for postoperative pain in arthroscopic rotator cuff repair: a prospective randomized controlled trial
err2021-12-01
err0
PREAI
errRichard A. Hillesheim; Padam Kumar; Tyler J. Brolin; David L. Bernholt; Paul M. Sethi; Marc S. Kowalsky; Frederick M. Azar; Thomas W. Throckmorton
errShare
errSave
Structural magnetic resonance imaging findings in severe mental disorders adult inpatients: A systematic review
err2022-10-01
err0
PREAI
errAugusto Mädke Brenner; Felipe Cesar de Almeida Claudino; Luísa Monteiro Burin; Victória Machado Scheibe; Barbara Larissa Padilha; Gianfranco Rizzotto de Souza; Juliana Avila Duarte; Neusa Sica da Rocha
errShare
errSave
Cerebro: Static Subsuming Mutant Selection
err2023-01-01
err11
errOAAI
errGarg, Aayush; Ojdanic, Milos; Degiovanni, Renzo; Chekam, Thierry Titcheu; Papadakis, Mike; Le Traon, Yves
errShare
errSave
Mutation testing in the wild: findings from GitHub
err2022-07-18
err13
errOAAI
errSanchez, Ana B.; Delgado-Perez, Pedro; Medina-Bulo, Inmaculada; Segura, Sergio
errShare
errSave
Effect of Blade Thickness on Internal Flow and Performance of a Plastic Centrifugal Pump
err2022-01-14
err0
errOAAI
errZhenfa Xu; Fanyu Kong; Lingfeng Tang; Mingwei Liu; Jiaqiong Wang; Ning Qiu
errShare
errSave
Electrochemical Impedance Spectroscopy and Determination of the Internal Resistance as a Way to Estimate Lead-Acid Batteries Condition
err2018-12-12
err0
errOAAI
errWłodzimierz Majchrzycki; Ewa Jankowska; Marek Baraniak; Piotr Handzlik; Robert Samborski
errShare
errSave
Neurally dissociable cognitive components of reading deficits in subacute stroke
err2015-05-27
err0
errOAAI
errOlga Boukrina; A. M. Barrett; Edward J. Alexander; Bing Yao; William W. Graves
errShare
errSave
researcher View more