.png){kind=icon}
返回
Does Automated Unit Test Generation Really Help Software Testers? A Controlled Empirical Study
.png){kind=icon}
OA
AI
DOI：10.1145/2699688.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Work on automated test generation has produced several tools capable of generating test data which achieves high structural coverage over a program. In the absence of a specification, developers are expected to manually construct or verify the test oracle for each test input. Nevertheless, it is assumed that these generated tests ease the task of testing for the developer, as testing is reduced to checking the results of tests. While this assumption has persisted for decades, there has been no conclusive evidence to date confirming it. However, the limited adoption in industry indicates this assumption may not be correct, and calls into question the practical value of test generation tools. To investigate this issue, we performed two controlled experiments comparing a total of 97 subjects split between writing tests manually and writing tests with the aid of an automated unit test generation tool, EVOSUITE. We found that, on one hand, tool support leads to clear improvements in commonly applied quality metrics such as code coverage (up to 300% increase). However, on the other hand, there was no measurable improvement in the number of bugs actually found by developers. Our results not only cast some doubt on how the research community evaluates test generation tools, but also point to improvements and future work necessary before automated test generation tools will be widely adopted by practitioners.
Keyword:
Algorithms
Experimentation
Reliability
Theory
Unit testing
automated test generation
branch coverage
empirical software engineering
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
A
IF:
6.2
论文数:
1.2K
被引数:
3.4K
机构
引用论文
分享收藏A Theoretical and Empirical Study of Search-Based Testing: Local, Global, and Hybrid Search基于搜索的测试的理论和实证研究: 本地，全局和混合搜索
PREAI
分享收藏分享收藏Quantitative estimation of clay minerals in airborne hyperspectral data using a calibration field
OAAI
OAAI分享收藏Effect of alkalized urine on renal calculi in patients with gout: a protocol for a placebo-controlled, double-blinded randomized controlled trial.png)
TrialsOAAI
TrialsIF0
OAAI分享收藏分享收藏
查看更多内容