arrow
Return

Is code coverage of performance tests related to source code features? An empirical study on open-source Java systems

delete2025-08-30
delete0
delete
OA
AI
M
Muhammad Imran *
V
Vittorio Cortellessa
D
Davide Di Ruscio
R
Riccardo Rubei
L
Luca Traini
DOI:10.1007/s10664-025-10712-3delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Performance testing aims to ensure the operational efficiency of software systems. However, many factors influencing the efficacy and adoption of performance tests in practice are not yet fully understood. For instance, while code coverage is widely regarded as a key quality metric for evaluating the efficacy of functional testing suites, there is limited knowledge about the types and levels of coverage that performance tests specifically achieve. Another important factor, often perceived as a barrier to the broader adoption of performance tests yet remaining relatively unexplored, is their extended execution time. In this paper, we examine (i) the coverage of performance testing suites, (ii) the characteristics of source code associated with performance-tested components, and (iii) the time cost of executing performance tests. Our analysis on open-source Java systems reveals that performance tests achieve significantly lower code coverage than functional tests, as expected, and it highlights a significant trade-off between coverage and execution time. Our results also indicate a lack of generalizable characteristics in the source code covered by performance tests.
Keywords:
Performance Testing
Unit Testing
JMH
JUnit
Java
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Empirical Software Engineering cover
Empirical Software Engineering
IF:
3.6
Papers:
2.0K
Citations:
5.3K

Organization

No organization information available