arrow
Return

Missing data imputation using utility-based regression and sampling approaches

delete2022-11-01
delete10
delete
OA
AI
H
Halimu N. Haliduola
F
Frank Bretz
U
Ulrich Mansmann *
DOI:10.1016/j.cmpb.2022.107172delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Data are often missing not at random (MNAR) in scientific experiments. We treat the MNAR problem as an imbalanced learning task. Standard predictive error measures of regression (e.g., mean squared error) are not suitable for imbalanced learning problems, such as in clinical trials where extreme values tend to be MNAR. We investigate hybrid imbalanced learning approaches that combine utility-based regression (UBR) with synthetic minority oversampling technique for regression (SMOTER) in cross-sectional trial settings. UBR optimizes the product of the conditional probability density (estimated by quantile regression forests) and a utility function which takes the relevance of the target variable value and the prediction error into account. SMOTER oversamples the relevant rare cases. Simulations show that the proposed method provides plausible predictions and reduces the bias for realistic missing data scenarios when compared with standard approaches like random forests and multiple imputation (systematic bias is observed in those methods, i.e., a tendency to underestimate the mean and standard deviation given the presence of MNAR in the area of high values of the target variable). The proposed method is implemented in a real dataset from an antidepressant clinical trial, and similar pattern of the systematic bias from commonly used methods is observed in the real data compare to the proposed method. Therefore, we encourage the integration of utility-based learning strategies for handling of missing data in the analysis of clinical trials. (C) 2022 The Authors. Published by Elsevier B.V.
Keywords:
Missing data
Utility-based regression
SMOTER
Machine learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Computer Methods and Programs in Biomedicine cover
Computer Methods and Programs in Biomedicine
IF:
4.8
Papers:
6.9K
Citations:
2.1W

Organization

U
University of Munich
Scholars:
5.7W
Papers: 4.2W
Citations: 68
N
Novartis
Scholars:
1.8W
Papers: 9.5K
Citations: 2.9K