arrow
返回

Optimizing Imputation for Educational Data: Exploring Training Partition and Missing Data Ratios

delete2024-01-01
delete0
PRE
AI
Z
Zachary K. Collier *
K
Kamal Chawla
O
Olushola Soyoye *
DOI:10.1080/00220973.2023.2287447delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The integration of machine learning in educational data analysis presents challenges regarding the availability of sufficient training data, especially in the context of high missing data ratios. These challenges arise from data partitioning practices, resulting in smaller datasets and less precise models. Behavioral scientists have increasingly incorporated machine learning into propensity score estimation, necessitating investigations into the most effective training and testing partitioning methods for machine learning-based imputation. To address this gap in the literature, our Monte Carlo experiment examines the impact of partitioning methods and missing data ratios. Simulated datasets, featuring missing ratios of 10%, 30%, 50%, and 70%, are divided into training and testing sets, ranging from 80–20 to 20–80. Results indicate that each imputation method delivers highly accurate average treatment effects. However, in the context of maintaining covariate balance across diverse conditions, complex ensemble methods outperform artificial neural networks. A real-data comparison (Study II) further underscores that the adoption of sophisticated machine learning techniques significantly enhances covariate balance. This research contributes valuable insights into the development of machine learning-based imputation methods, with a specific focus on scenarios characterized by high missing data ratios, in educational data analysis.
Keyword:
Imputation
neural networks
propensity score analysis
random forest

期刊

J
Journal of Experimental Education
IF:
1.7
论文数:
125
被引数:
2.8K

机构

U
University of De
学者数:
2
论文数: 1
被引数: 0
引用论文

引用论文

Neural Networks to Estimate Generalized Propensity Scores for Continuous Treatment Doses
err2021-03-03
err4
errOAAI
errCollier, Zachary K.; Leite, Walter L.; Karpyn, Allison
err分享
err收藏
Propensity score analysis with partially observed covariates: How should multiple imputation be used?
err2017-06-02
err0
errOAAI
errClémence Leyrat; Shaun R Seaman; Ian R White; Ian Douglas; Liam Smeeth; Joseph Kim; Matthieu Resche-Rigon; James R Carpenter; Elizabeth J Williamson
err分享
err收藏
Propensity Score Matching for Education Data: Worked Examples
err2019-01-07
err0
PREAI
errMarvin G. Powell; Darrell M. Hull; A. Alexander Beaujean
err分享
err收藏
学者 查看更多内容