arrow
Return

Adaptive optimization for prediction with missing data

delete2025-03-24
delete0
delete
OA
AI
D
Dimitris Bertsimas
A
Arthur Delarue *
J
Jean Pauphilet
DOI:10.1007/s10994-025-06757-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
When training predictive models on data with missing entries, the most widely used and versatile approach is a pipeline technique where we first impute missing entries and then compute predictions. In this paper, we view prediction with missing data as a two-stage adaptive optimization problem and propose a new class of models, adaptive linear regression models, where the regression coefficients adapt to the set of observed features. We show that some adaptive linear regression models are equivalent to learning an imputation rule and a downstream linear regression model simultaneously instead of sequentially. We leverage this joint-impute-then-regress interpretation to generalize our framework to non-linear models. In settings where data is strongly not missing at random, our methods achieve a 2-10% improvement in out-of-sample accuracy.
Keywords:
Missing data
Adaptive optimization

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.7K
Citations:
3.4W

Organization

M
mit
Scholars:
1.9K
Papers: 933
Citations: 620
Cited Papers

Cited Papers

The Missing Indicator Method: From Low to High Dimensions
err2023-08-04
err0
errOAAI
errMike Van Ness; Tomas M. Bosschieter; Roberto Halpin-Gregorio; Madeleine Udell
errShare
errSave
A Distribution-Free Theory of Nonparametric Regression
err2002-01-01
err0
errOAAI
errLászló Györfi; Michael Kohler; Adam Krzyżak; Harro Walk
errShare
errSave
A survey on missing data in machine learning
err2021-10-27
err324
errOAAI
errEmmanuel, Tlamelo; Maupong, Thabiso; Mpoeleng, Dimane; Semong, Thabo; Mphago, Banyatsang; Tabona, Oteng
errShare
errSave
mice: Multivariate Imputation by Chained Equations inR
err2011-01-01
err0
errOAAI
errStef van Buuren; Karin Groothuis-Oudshoorn
errShare
errSave
On the consistency of supervised learning with missing values
err2024-09-12
err0
errOAAI
errJulie Josse; Jacob M. Chen; Nicolas Prost; Gaël Varoquaux; Erwan Scornet
errShare
errSave
Adaptive optimization for prediction with missing data
err2025-03-24
err0
errOAAI
errBertsimas, Dimitris; Delarue, Arthur; Pauphilet, Jean
errShare
errSave
researcher View more