arrow
返回

Case study identification: A trivial indicator outperforms human classifiers

delete2023-09-01
delete1
delete
OA
AI
A
Austen Rainer
C
Claes Wohlin *
DOI:10.1016/j.infsof.2023.107252delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Context: The definition and term case studyare not being applied consistently by software engineering researchers. We previously developed a trivial smell indicatorto help detect the misclassification of primary studies as case studies. Objective: To evaluate the performance of the indicator. Methods: We compare the performance of the indicator against human classifiers for three datasets, two datasets comprising classifications by both authors of systematic literature studies and primary studies, and one dataset comprising only primary-study author classifications. Results: The indicator outperforms the human classifiers for all datasets. Conclusions: The indicator is successful because human classifiers failto properly classify their own, and others', primary studies. Consequently, reviewers of primary studies and authors of systematic literature studies could use the classifier as a sanitycheck for primary studies. Moreover, authors might use the indicator to double-check how they classified a study, as part of their analysis, and prior to submitting their manuscript for publication. We challenge the research community to both beat the indicator, and to improve its ability to identify true case studies.
Keyword:
Case study
Evaluation
Systematic review
Primary study
Smell indicator
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Information and Software Technology 封面图
Information and Software Technology
IF:
4.3
论文数:
3.8K
被引数:
7.7K

机构

Q
Queen's University Belfast
学者数:
1.6W
论文数: 1.7W
被引数: 2.5W
B
blekinge institute technology
学者数:
750
论文数: 764
被引数: 5
引用论文

引用论文

Use and Misuse of the Term Experiment in Mining Software Repositories Research
err2022-11-01
err9
errOAAI
errAyala, Claudia; Turhan, Burak; Franch, Xavier; Juristo, Natalia
err分享
err收藏
Empirical software product line engineering: A systematic literature review经验软件产品线工程: 系统文献综述
err2020-12-01
err15
PREAI
errEva Chacon-Luna, Ana; Manuel Gutierrez, Antonio; Galindo, Jose A.; Benavides, David
err分享
err收藏
An experimental study of flow and transport in fractured slate
err1993-06-01
err0
PREAI
errK.A. Cliffe; D. Gilling; N.L. Jefferies; T.R. Lineham
err分享
err收藏
err分享
err收藏
没有更多内容