arrow
Return

Value function gradient learning for large-scale multistage stochastic programming problems

delete2023-07-01
delete5
delete
OA
AI
J
Jinkyu Lee
S
S. J. Bae
W
Woo Chang Kim *
Y
Yongjae Lee *
DOI:10.1016/j.ejor.2022.10.011delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
A stagewise decomposition algorithm called value function gradient learning (VFGL) is proposed for large-scale multistage stochastic convex programs. VFGL finds the parameter values that best fit the gra-dient of the value function within a given parametric family. Widely used decomposition algorithms for multistage stochastic programming, such as stochastic dual dynamic programming (SDDP), approximate the value function by adding linear subgradient cuts at each iteration. Although this approach has been successful for linear problems, nonlinear problems may suffer from the increasing size of each subprob-lem as the iteration proceeds. On the other hand, VFGL has a fixed number of parameters; thus, the size of the subproblems remains constant throughout the iteration. Furthermore, VFGL can learn the param-eters by means of stochastic gradient descent, which means that it can be easil0y parallelized and does not require a scenario tree approximation of the underlying uncertainties. VFGL was compared with a deterministic equivalent formulation of the multistage stochastic programming problem and SDDP ap-proaches for three illustrative examples: production planning, hydrothermal generation, and the lifetime financial planning problem. Numerical examples show that VFGL generates high-quality solutions and is computationally efficient.(c) 2022 Elsevier B.V. All rights reserved.
Keywords:
Decision processes
Large-scale optimization
Multistage stochastic programming
Stagewise decomposition
Value function approximation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

European Journal of Operational Research cover
European Journal of Operational Research
IF:
6
Papers:
2.2W
Citations:
6.4W

Organization

No organization information available
Cited Papers

Cited Papers

An exploration of the judgement of sexual situations by adolescents with autism spectrum disorders versus typically developing adolescents
err2017-04-01
err0
errOAAI
errKirsten Visser; Kirstin Greaves-Lord; Nouchka T. Tick; Frank C. Verhulst; Athanasios Maras; Esther J.M. van der Vegt
errShare
errSave
Tensile Properties of Al-12Si Fabricated via Selective Laser Melting (SLM) at Different Temperatures
err2016-12-02
err0
errOAAI
errKonda Gokuldoss Prashanth; Sergio Scudino; Jürgen Eckert
errShare
errSave
Analysis of Gluten in Foods by MALDI-TOFMS
err2024-04-26
err0
PREAI
errEnrique Méndez; Israel Valdés; Emilio Camafeita
errShare
errSave
errShare
errSave
Regressed retinopathy of prematurity and its sequelae in children aged 5-10 years.
err1991-09-01
err0
errOAAI
errJ E Gallo; G Holmstrom; U Kugelberg; B Hedquist; G Lennerstrand
errShare
errSave
Optimization of small RNA extraction and comparative study of NGS library preparation from low count sperm samples
err2021-06-03
err0
PREAI
errVictoria Shtratnikova; Vladimir Naumov; Vitaly Bezuglov; Anna Zheludkevich; Luidmila Smigulina; Yury Dikov; Tatiana Denisova; Alexander Suvorov; J. Richard Pilsner; Russ Hauser; Stephen A. Krawetz; Oleg Sergeyev
errShare
errSave
errShare
errSave
researcher View more