arrow
Return

Optimizing Imputation for Educational Data: Exploring Training Partition and Missing Data Ratios

delete2024-01-01
delete0
PRE
AI
Z
Zachary K. Collier *
K
Kamal Chawla
O
Olushola Soyoye *
DOI:10.1080/00220973.2023.2287447delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The integration of machine learning in educational data analysis presents challenges regarding the availability of sufficient training data, especially in the context of high missing data ratios. These challenges arise from data partitioning practices, resulting in smaller datasets and less precise models. Behavioral scientists have increasingly incorporated machine learning into propensity score estimation, necessitating investigations into the most effective training and testing partitioning methods for machine learning-based imputation. To address this gap in the literature, our Monte Carlo experiment examines the impact of partitioning methods and missing data ratios. Simulated datasets, featuring missing ratios of 10%, 30%, 50%, and 70%, are divided into training and testing sets, ranging from 80–20 to 20–80. Results indicate that each imputation method delivers highly accurate average treatment effects. However, in the context of maintaining covariate balance across diverse conditions, complex ensemble methods outperform artificial neural networks. A real-data comparison (Study II) further underscores that the adoption of sophisticated machine learning techniques significantly enhances covariate balance. This research contributes valuable insights into the development of machine learning-based imputation methods, with a specific focus on scenarios characterized by high missing data ratios, in educational data analysis.
Keywords:
Imputation
neural networks
propensity score analysis
random forest

Journal

J
Journal of Experimental Education
IF:
1.7
Papers:
125
Citations:
2.8K

Organization

U
University of De
Scholars:
2
Papers: 1
Citations: 0
Cited Papers

Cited Papers

Neural Networks to Estimate Generalized Propensity Scores for Continuous Treatment Doses
err2021-03-03
err4
errOAAI
errCollier, Zachary K.; Leite, Walter L.; Karpyn, Allison
errShare
errSave
Propensity score analysis with partially observed covariates: How should multiple imputation be used?
err2017-06-02
err0
errOAAI
errClémence Leyrat; Shaun R Seaman; Ian R White; Ian Douglas; Liam Smeeth; Joseph Kim; Matthieu Resche-Rigon; James R Carpenter; Elizabeth J Williamson
errShare
errSave
Propensity Score Matching for Education Data: Worked Examples
err2019-01-07
err0
PREAI
errMarvin G. Powell; Darrell M. Hull; A. Alexander Beaujean
errShare
errSave
researcher View more