arrow
Return

Integrated Conditional Estimation-Optimization

delete2025-10-01
delete0
PRE
AI
M
Meng Qi *
P
Paul Grigas
Z
Zuo‐Jun Max Shen
DOI:10.1287/opre.2023.0427delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Many real-world optimization problems involve uncertain parameters with probability distributions that can be estimated using contextual feature information. In contrast to the standard approach of first estimating the distribution of uncertain parameters and then optimizing the objective based on the estimation, we propose an integrated conditional estimation-optimization (ICEO) framework that estimates the underlying conditional distribution of the random parameter while considering the structure of the optimization problem. We directly model the relationship between the conditional distribution of the random parameter and the contextual features and then estimate the probabilistic model with an objective that aligns with the downstream optimization problem. We show that our ICEO approach is asymptotically consistent under moderate regularity conditions and further provide finite performance guarantees in the form of generalization bounds. Computationally, performing estimation with the ICEO approach is a nonconvex and often nondifferentiable optimization problem. We propose a general methodology for approximating the potentially nondifferentiable mapping from estimated conditional distribution to the optimal decision by a differentiable function, which greatly improves the performance of gradient-based algorithms applied to the nonconvex problem. We also provide a polynomial optimization solution approach in the semi-algebraic case. Numerical experiments are also conducted to show the empirical success of our approach in different situations, including with limited data samples and model mismatches.
Keywords:
contextual stochastic optimization
prescriptive analytics
statistical learning theory
integrated estimation-optimization
end-to-end learning

Journal

O
Operations Research
IF:
2.6
Papers:
92
Citations:
1.5W

Organization

University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
U
university of california berkeley
Scholars:
1.3K
Papers: 773
Citations: 0
C
cornell university
Scholars:
5.1K
Papers: 2.1K
Citations: 0
researcher View more organizations