arrow
Return

Estimating missing data using novel correlation maximization based methods

delete2020-06-01
delete16
PRE
AI
N
Negin Daneshpour *
DOI:10.1016/j.asoc.2020.106249delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The accurate estimation of missing data plays a vital role in ensuring a high level of data quality. The missing values should be imputed before performing data mining, machine learning, and other data processing tasks. Ten correlation-based imputation methods are proposed in this paper. All of these methods try to maximize the correlation between a missing feature and other features. The maximization is achieved by selecting segments of data that have strong correlations. The proposed approach involves the following main steps to impute each missing instance. First, a base set is selected from complete instances. Second, data segments with strong correlations are generated using the base set and the rest of the complete instances. Finally, each missing value is imputed by applying linear models to the discovered segments of data. This study considers seven real datasets from different fields with different missing rates. The imputation quality of the proposed methods is compared to those of seven other imputation approaches in terms of three well-known evaluation criteria. The experimental results reveal that the proposed approach has better imputation performance than competing imputation techniques in most cases. (C) 2020 Elsevier B.V. All rights reserved.
Keywords:
Missing values
Imputation
Correlation
Regression
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

S
shahid rajaee teacher training university (srttu)
Scholars:
1.0K
Papers: 1.0K
Citations: 0
Cited Papers

Cited Papers

Ensemble correlation-based low-rank matrix completion with applications to traffic data imputation
err2017-09-01
err57
PREAI
errChen, Xiaobo; Wei, Zhongjie; Li, Zuoyong; Liang, Jun; Cai, Yingfeng; Zhang, Bob
errShare
errSave
The Damage Pattern to the Gastrointestinal Tract Depends on the Nature of the Ingested Caustic Agent
err2016-02-26
err0
PREAI
errRomain Ducoudray; Antoine Mariani; Helene Corte; Aurore Kraemer; Nicolas Munoz‐Bongrand; Emile Sarfati; Pierre Cattan; Mircea Chirica
errShare
errSave
errShare
errSave
Missing data imputation using fuzzy-rough methods
err2016-09-01
err110
errOAAI
errAmiri, Mehran; Jensen, Richard
errShare
errSave
Imputation of missing data with neural networks for classification
err2019-10-01
err77
PREAI
errChoudhury, Suyra Jyoti; Pal, Nikhil R.
errShare
errSave
Imputations of missing values using a tracking-removed autoencoder trained with incomplete data
err2019-11-01
err41
PREAI
errLai, Xiaochen; Wu, Xia; Zhang, Liyong; Lu, Wei; Zhong, Chongquan
errShare
errSave
researcher View more