Mixed Data Imputation Using Generative Adversarial Networks

doi:10.1109/ACCESS.2022.3218067

Mixed Data Imputation Using Generative Adversarial Networks

2022-01-01

7

OA

AI

Mohammad Mehedy Masud

DOI：10.1109/ACCESS.2022.3218067

原文链接

原文求助

摘要

En 中文

Missing values are common in real-world datasets and pose a significant challenge to the performance of statistical and machine learning models. Generally, missing values are imputed using statistical methods, such as the mean, median, mode, or machine learning approaches. These approaches are limited to either numerical or categorical data. Imputation in mixed datasets that contain both numerical and categorical attributes is challenging and has received little attention. Machine learning-based imputation algorithms usually require a large amount of training data. However, obtaining such data is difficult. Furthermore, no considerate work has been conducted in the literature that focuses on the effects of the training and testing size with increasing amounts of missing data. To address this gap, we proposed that increasing the amount of training data will improve imputation performance. We first used generative adversarial network (GAN) methods to increase the amount of training data. We considered two state-of-the-art GANs (tabular and conditional tabular) to add synthetic samples using observed data with different synthetic sample ratios. We then used three state-of-the-art imputation models that can handle mixed data: MissForest, multivariate imputation by chained equations, and denoising auto encoder (DAE). We proposed robust experimental setups on four publicly available datasets with different training-testing data divisions that have increasing missingness ratios. Extensive experimental results show that incorporating synthetic samples with training data achieves better performance compared to the baseline methods for mixed data imputation in both categorical and numerical variables, especially for large missingness ratios.

Keyword:

Training data

Generative adversarial networks

Generators

Statistics

Data models

Machine learning algorithms

Prediction algorithms

Sequential analysis

Multivariate regression

Mixed data imputation

missing data

GANs

miss forest

MICE

denoising auto encoders

Mixed Data Imputation Using Generative Adversarial Networks

摘要

期刊

机构

引用论文