arrow
Return

Gaussian processes for missing value imputation

delete2023-08-01
delete7
delete
OA
AI
B
Bahram Jafrasteh *
D
Daniel Hernández-Lobato
S
Simón Pedro Lubián‐López
I
Isabel Benavente‐Fernández
DOI:10.1016/j.knosys.2023.110603delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
A missing value indicates that a particular attribute of an instance of a learning problem is not recorded. They are very common in many real-life datasets. In spite of this, however, most machine learning methods cannot handle missing values. Thus, they should be imputed before training. Gaussian Processes (GPs) are non-parametric models with accurate uncertainty estimates that combined with sparse approximations and stochastic variational inference scale to large data sets. Sparse GPs (SGPs) can be used to get a predictive distribution for missing values. We present a hierarchical composition of sparse GPs that is used to predict the missing values at each dimension using the observed values from the other dimensions. Importantly, we consider that the input attributes to each sparse GP used for prediction may also have missing values. The missing values in those input attributes are replaced by the predictions of the previous sparse GPs in the hierarchy. We call our approach missing GP (MGP). MGP can impute all observed missing values. It outputs a predictive distribution for each missing value that is then used in the imputation of other missing values. We evaluate MGP on one private clinical data set and on four UCI datasets with a different percentage of missing values. Furthermore, we compare the performance of MGP with other state-of-the-art methods for imputing missing values, including variants based on sparse GPs and deep GPs. Our results show that the performance of MGP is significantly better. (c) 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
Keywords:
Missing values
Gaussian process
Deep learning
Deep Gaussian processes
Variational inference
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.2W
Citations:
4.5W

Organization

U
universidad de cadiz
Scholars:
7.2K
Papers: 5.8K
Citations: 7
A
Autonomous University of Madrid
Scholars:
2.1W
Papers: 1.7W
Citations: 29