arrow
返回

A data-driven missing value imputation approach for longitudinal datasets

delete2021-03-06
delete13
delete
OA
AI
R
Ribeiro, Caio *
A
Alex A. Freitas
DOI:10.1007/s10462-021-09963-5delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Longitudinal datasets of human ageing studies usually have a high volume of missing data, and one way to handle missing values in a dataset is to replace them with estimations. However, there are many methods to estimate missing values, and no single method is the best for all datasets. In this article, we propose a data-driven missing value imputation approach that performs a feature-wise selection of the best imputation method, using known information in the dataset to rank the five methods we selected, based on their estimation error rates. We evaluated the proposed approach in two sets of experiments: a classifier-independent scenario, where we compared the applicabilities and error rates of each imputation method; and a classifier-dependent scenario, where we compared the predictive accuracy of Random Forest classifiers generated with datasets prepared using each imputation method and a baseline approach of doing no imputation (letting the classification algorithm handle the missing values internally). Based on our results from both sets of experiments, we concluded that the proposed data-driven missing value imputation approach generally resulted in models with more accurate estimations for missing data and better performing classifiers, in longitudinal datasets of human ageing. We also observed that imputation methods devised specifically for longitudinal data had very accurate estimations. This reinforces the idea that using the temporal information intrinsic to longitudinal data is a worthwhile endeavour for machine learning applications, and that can be achieved through the proposed data-driven approach.
Keyword:
Longitudinal datasets
Missing Value Imputation
Supervised Machine Learning
Class Imbalance

期刊

Artificial Intelligence Review 封面图
Artificial Intelligence Review
IF:
13.9
论文数:
6.1K
被引数:
1.9W

机构

U
University of Kent
学者数:
5.3K
论文数: 6.1K
被引数: 8.1K
引用论文

引用论文

Cytotoxic Effects of Water-Soluble Extracts of Coarse and Fine Atmospheric Particulate Matter on Mast Cell Lines
err2021-01-01
err0
errOAAI
errHiromi Kataoka; Kaori Tanaka; Keiko Tazuya-Murayama; Taku Yamashita; Jun-ichi Nishikawa
err分享
err收藏
err分享
err收藏
Inchworm-Like Colonoscopic Robot with Hollow Body and Steering Device
err2006-01-01
err0
errOAAI
errByungkyu KIM; Hun Young LIM; Jong Hyeon PARK; Jong-Oh PARK
err分享
err收藏
High temperature sensitivity of monoterpene emissions from global vegetation
err2024-01-08
err0
errOAAI
errEfstratios Bourtsoukidis; Andrea Pozzer; Jonathan Williams; David Makowski; Josep Peñuelas; Vasileios N. Matthaios; Georgia Lazoglou; Ana Maria Yañez-Serrano; Jos Lelieveld; Philippe Ciais; Mihalis Vrekoussis; Nikos Daskalakis; Jean Sciare
err分享
err收藏
err分享
err收藏
Challenges in Automotive Fuel Cells Recycling
err2016-12-01
err0
errOAAI
errRikka Wittstock; Alexandra Pehlken; Michael Wark
err分享
err收藏
Intake of Heavy Metals through Milk and Toxicity Assessment
err2017-07-01
err0
errOAAI
errAmir Ismail; Muhammad Riaz; Saeed Akhtar; Farooq Amjad; Muhammad Arif Shahzad; Ahmad Mujtaba
err分享
err收藏
An up-to-date comparison of state-of-the-art classification algorithms
err2017-10-01
err294
PREAI
errZhang, Chongsheng; Liu, Changchang; Zhang, Xiangliang; Almpanidis, George
err分享
err收藏
How to deal with missing longitudinal data in cost of illness analysis in Alzheimer's disease-suggestions from the GERAS observational study
err2016-07-18
err14
errOAAI
errBelger, Mark; Haro, Josep Maria; Reed, Catherine; Happich, Michael; Kahle-Wrobleski, Kristin; Argimon, Josep Maria; Bruno, Giuseppe; Dodel, Richard; Jones, Roy W.; Vellas, Bruno; Wimo, Anders
err分享
err收藏
学者 查看更多内容