arrow
返回

Effect of Missing Data Types and Imputation Methods on Supervised Classifiers: An Evaluation Study

delete2023-03-22
delete6
delete
OA
AI
M
Menna Ibrahim Gabr *
Y
Yehia Helmy
D
Doaa S. Elzanfaly
DOI:10.3390/bdcc7010055delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Data completeness is one of the most common challenges that hinder the performance of data analytics platforms. Different studies have assessed the effect of missing values on different classification models based on a single evaluation metric, namely, accuracy. However, accuracy on its own is a misleading measure of classifier performance because it does not consider unbalanced datasets. This paper presents an experimental study that assesses the effect of incomplete datasets on the performance of five classification models. The analysis was conducted with different ratios of missing values in six datasets that vary in size, type, and balance. Moreover, for unbiased analysis, the performance of the classifiers was measured using three different metrics, namely, the Matthews correlation coefficient (MCC), the F1-score, and accuracy. The results show that the sensitivity of the supervised classifiers to missing data differs according to a set of factors. The most significant factor is the missing data pattern and ratio, followed by the imputation method, and then the type, size, and balance of the dataset. The sensitivity of the classifiers when data are missing due to the Missing Completely At Random (MCAR) pattern is less than their sensitivity when data are missing due to the Missing Not At Random (MNAR) pattern. Furthermore, using the MCC as an evaluation measure better reflects the variation in the sensitivity of the classifiers to the missing data.
Keyword:
data quality
data completeness
missing patterns
imputation techniques
supervised
classifiers
performance measures

期刊

B
Big Data and Cognitive Computing
IF:
4.4
论文数:
1.3K
被引数:
2.4K

机构

H
helwan university
学者数:
2.0K
论文数: 1.6K
被引数: 3
E
egyptian knowledge bank (ekb)
学者数:
11.6W
论文数: 9.3W
被引数: 84
引用论文

引用论文

Potencial antimicrobiano e alelopático das amidas isoladas do extrato das raízes de Ottonia martiana Miq.
err2006-07-01
err0
errOAAI
errMiriam Machado Cunico; Josiane G. Dias; Marilis D. Miguel; Obdulio Gomes Miguel; Celso Garcia Auer; Lílian C. Côcco; André R. Lopes; Carlos I. Yamamoto; Franco Delle Monache
err分享
err收藏
Avaliação ecotoxicológica de efluentes tratados por alagados construídos处理过的人工湿地出水的生态毒理学评估
err2019-12-01
err0
errOAAI
errLeonardo Beltrão Barszcz; Filipe Cardoso Bellato; Roseli Frederigi Benassi; Dácio Roberto Matheus
err分享
err收藏
The impact of class imbalance in classification performance metrics based on the binary confusion matrix
err2019-07-01
err590
errOAAI
errLuque, Amalia; Carrasco, Alejandro; Martin, Alejandro; de las Heras, Ana
err分享
err收藏
Long-Term Oxygen Therapy
err1995-09-14
err0
PREAI
errStephen P. Tarpy; Bartolome R. Celli
err分享
err收藏
学者 查看更多内容