arrow
返回

Optimized ensemble value function approximation for dynamic programming

delete2023-09-01
delete3
delete
OA
AI
C
Cristiano Cervellera *
DOI:10.1016/j.ejor.2023.01.049delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Approximate dynamic programming (ADP) is the standard tool for the solution of multistage dynamic optimization problems under general conditions, such as nonlinear state equation and cost, and continuous state and control spaces. In the typical ADP implementation, the value function is approximated by means of a single model trained over a suitable sampling of the state space. In this paper we investigate the ensemble learning paradigm in the ADP context, which consists in exploiting the outputs of many models trained for the value function approximation. To this purpose, we introduce an optimization scheme for the aggregation of the ensemble outputs, related to the supremum norm error on which the ADP accuracy depends. Furthermore, we show that the ensemble of value function approximations can be used to identify a-priori good state points used to train the approximating models, exploiting an ambiguity-like term tailored to the proposed ensemble optimization scheme. The advantages of ensembles in ADP are showcased both through error analysis and a simulation campaign involving various test problems. Our results show how ensembles obtained through the proposed output weights optimization scheme yield more accurate and robust value function approximations with respect to single elements. At the same time, we show how the ensembles can successfully be employed to select good state samples to be employed as training set for the value function approximations. (c) 2023 Elsevier B.V. All rights reserved.
Keyword:
Dynamic programming
Ensemble models
Value function approximation
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

European Journal of Operational Research 封面图
European Journal of Operational Research
IF:
6
论文数:
2.2W
被引数:
6.4W

机构

C
consiglio nazionale delle ricerche (cnr)
学者数:
6.2W
论文数: 5.7W
被引数: 48
引用论文

引用论文

Evaluating pitolisant as a narcolepsy treatment option
err2020-09-17
err0
PREAI
errStefano de Biase; Gaia Pellitteri; Gian Luigi Gigli; Mariarosaria Valente
err分享
err收藏
Electronic structures and optical properties of IV A elements-doped 3C-SiC from density functional calculations
err2018-11-28
err0
PREAI
errXuefeng Lu; Tingting Zhao; Xin Guo; Meng Chen; Junqiang Ren; Peiqing La
err分享
err收藏
Nonlinear Elasticity of Monolayer Graphene
err2009-06-11
err0
errOAAI
errEmiliano Cadelano; Pier Luca Palla; Stefano Giordano; Luciano Colombo
err分享
err收藏
err分享
err收藏
Time-series anomaly detection using dynamic programming based longest common subsequence on sensor data
err2023-03-01
err11
PREAI
errNguyen, Thi Phuong Quyen; Phuc, Phan Nguyen Ky; Yang, Chao -Lung; Sutrisno, Hendri; Luong, Bao-Han; Le, Thi Huynh Anh; Nguyen, Thanh Tung
err分享
err收藏
A Hollow Tube‐on‐Tube Architecture of Carbon‐Tube‐Supported Nickel Cobalt Sulfide Nanotubes for Advanced Supercapacitors
err2017-03-23
err0
PREAI
errNannan Wang; Yanjie Wang; Shizhong Cui; Hongwei Hou; Liwei Mi; Weihua Chen
err分享
err收藏
Efficient approximate dynamic programming based on design and analysis of computer experiments for infinite-horizon optimization
err2020-12-01
err8
errOAAI
errChen, Ying; Liu, Feng; Rosenberger, Jay M.; Chen, Victoria C. P.; Kulvanitchaiyanunt, Asama; Zhou, Yuan
err分享
err收藏
err分享
err收藏
学者 查看更多内容