.png){kind=icon}
Return
Construct Validity in Software Engineering
.png){kind=icon}
OA
AI
DOI：10.1109/TSE.2022.3176725.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Empirical research aims to establish generalizable claims from data. Such claims may involve concepts that must be measured indirectly by using indicators. Construct validity is concerned with whether one can justifiably make claims at the conceptual level that are supported by results at the operational level. We report a quantitative analysis of the awareness of construct validity in the software engineering literature between 2000 and 2019 and a qualitative review of 83 articles about human-centric experiments published in five high-quality journals between 2015 and 2019. Over the two decades, the appearance in the literature of the term construct validity increased sevenfold. Some of the reviewed articles we reviewed employed various ways to ensure that the indicators span the concept in an unbiased manner. We also found articles that reuse formerly validated constructs. However, the articles disagree about how to define construct validity. Several interpret construct validity excessively by including threats to internal, external, or statistical conclusion validity. A few articles also include fundamental challenges of a study, such as cheating and misunderstanding of experiment material. The diversity of topics included as threats to construct validity calls for a more minimalist approach. Based on the review, we propose seven guidelines to improve how construct validity is handled and reported in software engineering.
Keywords:
Software engineering
Systematics
Software measurement
Guidelines
Complexity theory
Object oriented modeling
Marine vehicles
Measurement
research quality
empirical research
systematic review
guidelines
Journal
IF:
5.6
Papers:
2.9K
Citations:
1.1W
Organization
Cited Papers
Membrane-bound domain of HMG CoA reductase is required for sterol-enhanced degradation of the enzyme.png)
Cell
CellIF0
PREAI
ShareSaveShareSaveTowards a reduction in architectural knowledge vaporization during agile global software development
OAAI
OAAIShareSaveShareSaveShareSaveShareSaveShareSaveTo log, or not to log: using heuristics to identify mandatory log events - a controlled experiment
PREAI
ShareSave
View more