.png){kind=icon}
返回
Raters' reliability in clone benchmarks construction
.png){kind=icon}
OA
AI
DOI：10.1007/s10664-015-9419-z.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Cloned code often complicates code maintenance and evolution and must therefore be effectively detected. One of the biggest challenges for clone detectors is to reduce the amount of irrelevant clones they found, called false positives. Several benchmarks of true and false positive clones have been introduced, enabling tool developers to compare, assess and fine-tune their tools. Manual inspection of clone candidates is performed by raters that do not have expertise on the underlying code. This way of building benchmarks might be unreliable when considering context-dependent clones i.e., clones valid for a specific purpose. Our goal is to investigate the reliability of rater judgments about context-dependent clones. We randomly select about 600 clones from two projects and ask several raters, including experts of the projects, to manually classify these clones. We observe that judgments of non expert raters are not always repeatable. We also observe that they seldomly agree with each others and with the expert. Finally, we find that the project and the fact that a clone is a true or false positive might have an influence on the agreement between the expert and non experts. Therefore, using non experts to produce clone benchmarks could be unreliable.
Keyword:
Duplication
Code clone
Empirical study
Software metrics
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
2.0K
被引数:
5.3K
机构
引用论文
Broadband leaky-wave antenna based on composite right/left handed substrate integrated waveguide
.png){kind=icon}
PREAI
分享收藏Lys63/Met1-hybrid ubiquitin chains are commonly formed during the activation of innate immune signallingLys63/Met1-hybrid泛素链通常在先天免疫信号激活过程中形成OAAI
OAAI分享收藏分享收藏分享收藏分享收藏分享收藏分享收藏
查看更多内容