arrow
Return

Data preprocessing issues for incomplete medical datasets

delete2016-06-09
delete20
PRE
AI
M
Min‐Wei Huang
W
Wei‐Chao Lin
C
Chih‐Wen Chen *
C
Chih‐Fong Tsai
W
William Eberle
DOI:10.1111/exsy.12155delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
While there is an ample amount of medical information available for data mining, many of the datasets are unfortunately incomplete - missing relevant values needed by many machine learning algorithms. Several approaches have been proposed for the imputation of missing values, using various reasoning steps to provide estimations from the observed data. One of the important steps in data mining is data preprocessing, where unrepresentative data is filtered out of the data to be mined. However, none of the related studies about missing value imputation consider performing a data preprocessing step before imputation. Therefore, the aim of this study is to examine the effect of two preprocessing steps, feature and instance selection, on missing value imputation. Specifically, eight different medical-related datasets are used, containing categorical, numerical and mixed types of data. Our experimental results show that imputation after instance selection can produce better classification performance than imputation alone. In addition, we will demonstrate that imputation after feature selection does not have a positive impact on the imputation result.
Keywords:
missing value
imputation
feature selection
instance selection
incomplete medical datasets

Journal

Expert Systems cover
Expert Systems
IF:
2.3
Papers:
2.6K
Citations:
3.8K

Organization

A
asia university taiwan
Scholars:
2.0K
Papers: 2.8K
Citations: 5
T
Taichung Veterans General Hospital
Scholars:
3.1K
Papers: 3.0K
Citations: 2
K
Kaohsiung Medical University
Scholars:
1.3W
Papers: 8.2K
Citations: 7.8K
T
Tennessee Technological University
Scholars:
1.0K
Papers: 911
Citations: 608
N
National Central University
Scholars:
1.0W
Papers: 8.6K
Citations: 6.4K
researcher View more organizations
Cited Papers

Cited Papers

DPABI: Data Processing & Analysis for (Resting-State) Brain Imaging
err2016-04-13
err0
PREAI
errChao-Gan Yan; Xin-Di Wang; Xi-Nian Zuo; Yu-Feng Zang
errShare
errSave
Dimensionality reduction using genetic algorithms
err2000-07-01
err606
PREAI
errRaymer, ML; Punch, WE; Goodman, ED; Kuhn, LA; Jain, AK
errShare
errSave
From Phenotypes to Genotypes and Back: Toward an Integrated Evaluation of Biodiversity in Calanoid Copepods
err2022-02-25
err0
errOAAI
errIole Di Capua; Rosa D’Angiolo; Roberta Piredda; Carmen Minucci; Ferdinando Boero; Marco Uttieri; Ylenia Carotenuto
errShare
errSave
Imputation of missing data in industrial databases
err1999-01-01
err205
PREAI
errLakshminarayan, K; Harp, SA; Samad, T
errShare
errSave
Power Walker Helps a Child with Cerebral Palsy
err2016-05-01
err0
errOAAI
errAnna McCormick; Hana Alazem; Aliasgar Morbi; Richard Beranek; Roselle Adler; Genevieve Tibi; Elizabeth Vilé
errShare
errSave
errShare
errSave
researcher View more