.png){kind=icon}
返回
Relevant Information in TDD Experiment Reporting
.png){kind=icon}
OA
AI
DOI：10.1145/3688837.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Experiments are a commonly used method of research in software engineering (SE). Researchers report their experiments following detailed guidelines. However, researchers do not, in the field of test-driven development (TDD) at least, specify how they operationalized the response variables and, particularly, the measurement process. This article has three aims: (i) identify the response variable operationalization components in TDD experiments that study external quality; (ii) study their influence on the experimental results; (iii) determine if the experiment reports describe the measurement process components that have an impact on the results. We used two-part sequential mixed methods research. The first part of the research adopts a quantitative approach applying a statistical analysis of the impact of the operationalization components on the experimental results. The second part follows with a qualitative approach applying a systematic mapping study (SMS). The test suites, intervention types and measurers have an influence on the measurements and results of the statistical analysis of TDD experiments in SE. The test suites have a major impact on both the measurements and the results of the experiments. The intervention type has less impact on the results than on the measurements. While the measurers have an impact on the measurements, this is not transferred to the experimental results. On the other hand, the results of our SMS confirm that TDD experiments do not usually report either the test suites, the test case generation method, or the details of how external quality was measured. A measurement protocol should be used to ensure that the measurements made by different measurers are similar. It is necessary to report the test cases, the experimental task and the intervention type in order to be able to reproduce the measurements and statistical analyses, as well as to replicate experiments and build dependable families of experiments.
Keyword:
TEST-DRIVEN DEVELOPMENT
EXTERNAL QUALITY
MEASUREMENT UNCERTAINTY
PRODUCTIVITY
期刊
A
IF:
6.2
论文数:
1.2K
被引数:
3.4K
机构
引用论文
.png){kind=icon}
MULTIPLE-DOSE PHARMACOKINETICS OF THE IMMUNOSUPPRESSANT SDZ RAD IN STABLE RENAL TRANSPLANT PATIENTS
PREAI
分享收藏分享收藏Lessons from applying the systematic literature review process within the software engineering domain在软件工程领域应用系统文献综述过程的经验教训
OAAI
OAAI分享收藏Electricity market prices for day-ahead ancillary services and energy: Texas前一天辅助服务和能源的电力市场价格: 德克萨斯州
PREAI
分享收藏High-Level Multidrug-ResistantEscherichia coliIsolates from Wild Birds in a Large Urban Environment
PREAI
分享收藏
查看更多内容