返回
Case study identification: A trivial indicator outperforms human classifiers
DOI:10.1016/j.infsof.2023.107252.png)
摘要
En 中文
Context: The definition and term case studyare not being applied consistently by software engineering researchers. We previously developed a trivial smell indicatorto help detect the misclassification of primary studies as case studies. Objective: To evaluate the performance of the indicator. Methods: We compare the performance of the indicator against human classifiers for three datasets, two datasets comprising classifications by both authors of systematic literature studies and primary studies, and one dataset comprising only primary-study author classifications. Results: The indicator outperforms the human classifiers for all datasets. Conclusions: The indicator is successful because human classifiers failto properly classify their own, and others', primary studies. Consequently, reviewers of primary studies and authors of systematic literature studies could use the classifier as a sanitycheck for primary studies. Moreover, authors might use the indicator to double-check how they classified a study, as part of their analysis, and prior to submitting their manuscript for publication. We challenge the research community to both beat the indicator, and to improve its ability to identify true case studies.
Keyword:
Case study
Evaluation
Systematic review
Primary study
Smell indicator
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
4.3
论文数:
3.8K
被引数:
7.7K
机构
引用论文
Guidelines for conducting and reporting case study research in software engineering在软件工程中进行和报告案例研究的指南
Case Study Research in Software Engineering-It is a Case, and it is a Study, but is it a Case Study?软件工程中的案例研究-它是一个案例,它是一个研究,但它是一个案例研究吗?
没有更多内容

