arrow
Return

Assessing individual contributions to software engineering projects: a replication study

delete2022-05-17
delete2
PRE
AI
C
Christopher Hundhausen *
P
Phillip Conrad
A
A.S. Carter
O
Olusola Adesope
DOI:10.1080/08993408.2022.2071543delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Background and Context: Assessing team members' indivdival contributions to software development projects poses a key problem for computing instructors. While instructors typically rely on subjective assessments, objective assessments could provide a more robust picture. To explore this possibility, In a 2020 paper, Buffardi presented a correlational analysis of objective metrics and subjective metrics in an advanced software engineering project course (n= 41 students and 10 teams), finding only two significant correlations. Objective: To explore the robustness of Buffardi's findings and gain further insight, we conducted a larger scale replication of the Buffardi study (n = 118 students and 25 teams) in three courses at three institutions. Method: We collected the same data as in the Buffardi study and computed the same measures from those data. We replicated Buffardi's exploratory, correlational and regression analyses of objective and subjective measures. Findings: While replicating four of Buffardi's five significant correlational findings and partially replicating the findings of Buffardi's regression analyses, our results go beyond those of Buffardi by identifying eight additional significant correlations.
Keywords:
Team software development projects
individual contributions
GitHub log data analysis
peer evaluation
issues
commits
user stories

Journal

C
Computer Science Education
IF:
2.2
Papers:
207
Citations:
1.1K

Organization

California State University System cover
California State University System
Scholars:
2.8W
Papers: 2.4W
Citations: 457
U
University of California Santa Barbara
Scholars:
1.2W
Papers: 9.6K
Citations: 3.6W
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
W
washington state university
Scholars:
1.8W
Papers: 1.6W
Citations: 114
researcher View more organizations