.png){kind=icon}
.png){kind=icon}
Return
Predicting Data Science Programming Performance: Using Fair ML to detect Bias
.png){kind=icon}
OA
AI
T
P
D
DOI：10.1186/s40561-026-00436-2.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
This study investigates the performance and fairness of predictive models designed to predict data science programming performance using fine-grained log data from a sample of students solving Data Science tasks in DaTu. Our analysis reveals that Logistic Regression outperformed other models in terms of accuracy. Through Variable Importance analysis, we found that the 'paste answer' variable emerged as a critical predictor for Logistic Regression and KNeighbors classifier models, whereas multiple variables contributed equally to the GaussianNB model's predictive power. We evaluated fairness, focusing on the variable 'chatbot access' (with or without access to chatbot), finding evidence of bias. The models demonstrated lower score distributions for the unprivileged group (no-AI access). To mitigate this bias, we employed various techniques: Resampling, Reweighting, and ROC pivot. Of these, only Reweighting significantly improved fairness metrics. As an alternative approach, we considered the ceteris paribus cutoff method to minimize parity loss. In conclusion, this study emphasizes the significance of evaluating fairness in educational predictive modeling. This work offers a nuanced and data-driven approach to assessing students' data science programming skills.
Keywords:
Artificial intelligence in education
Machine learning
Data science programming
Prediction
Performance
Fairness
Bias
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
S
IF:
12.1
Papers:
358
Citations:
2.4K
Organization
Cited Papers