arrow
返回

SICE: an improved missing data imputation technique

delete2020-06-12
delete106
delete
OA
AI
S
Shahidul Islam Khan *
DOI:10.1186/s40537-020-00313-wdelete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
In data analytics, missing data is a factor that degrades performance. Incorrect imputation of missing values could lead to a wrong prediction. In this era of big data, when a massive volume of data is generated in every second, and utilization of these data is a major concern to the stakeholders, efficiently handling missing values becomes more important. In this paper, we have proposed a new technique for missing data imputation, which is a hybrid approach of single and multiple imputation techniques. We have proposed an extension of popular Multivariate Imputation by Chained Equation (MICE) algorithm in two variations to impute categorical and numeric data. We have also implemented twelve existing algorithms to impute binary, ordinal, and numeric missing values. We have collected sixty-five thousand real health records from different hospitals and diagnostic centers of Bangladesh, maintaining the privacy of data. We have also collected three public datasets from the UCI Machine Learning Repository, ETH Zurich, and Kaggle. We have compared the performance of our proposed algorithms with existing algorithms using these datasets. Experimental results show that our proposed algorithm achieves 20% higher F-measure for binary data imputation and 11% less error for numeric data imputations than its competitors with similar execution time.
Keyword:
Missing Data Imputation
Single Imputation
Multiple Imputation
MICE
Data Analytics
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Journal of Big Data 封面图
Journal of Big Data
IF:
6.4
论文数:
1.5K
被引数:
1.1W

机构

暂无机构信息
引用论文

引用论文

Power source evaluation of a wireless power transfer system
err2014-05-01
err0
errOAAI
errGuillaume Vigneau; Mohamed Cheikh; Rachid Benbouhout; Said Bouguern; Alexandru Takacs
err分享
err收藏
err分享
err收藏
Missing data imputation using fuzzy-rough methods
err2016-09-01
err110
errOAAI
errAmiri, Mehran; Jensen, Richard
err分享
err收藏
err分享
err收藏
The Jeryl Lynn Vaccine Strain of Mumps Virus is a Mixture of Two Distinct Isolates
err1993-05-01
err0
errOAAI
errM. A. Afzal; A. R. Pickford; T. Forsey; A. B. Heath; P. D. Minor
err分享
err收藏
BAYESIAN LINEAR REGRESSION WITH SPARSE PRIORS
err2015-10-01
err284
errOAAI
errCastillo, Ismael; Schmidt-Hieber, Johannes; Van der Vaart, Aad
err分享
err收藏
学者 查看更多内容