arrow
返回

Low-discrepancy sampling for approximate dynamic programming with local approximators

delete2014-03-01
delete18
PRE
AI
C
Cristiano Cervellera *
M
Mauro Gaggero
D
Danilo Macciò
DOI:10.1016/j.cor.2013.09.006delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Approximate dynamic programming (ADP) relies, in the continuous-state case, on both a flexible class of models for the approximation of the value functions and a smart sampling of the state space for the numerical solution of the recursive Bellman equations. In this paper, low-discrepancy sequences, commonly employed for number-theoretic methods, are investigated as a sampling scheme in the ADP context when local models, such as the Nadaraya Watson (NW) ones, are employed for the approximation of the value function. The analysis is carried out both from a theoretical and a practical point of view. In particular, it is shown that the combined use of low-discrepancy sequences and NW models enables the convergence of the ADP procedure. Then, the regular structure of the low-discrepancy sampling is exploited to derive a method for automatic selection of the bandwidth of NW models, which yields a significant saving in the computational effort with respect to the standard cross validation approach. Simulation results concerning an inventory management problem are presented to show the effectiveness of the proposed techniques. (C) 2013 Elsevier Ltd. All rights reserved.
Keyword:
Approximate dynamic programming
Low-discrepancy sampling
Local approximation
Nadaraya-Watson models
Inventory forecasting
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

C
Computers and Operations Research
IF:
4.3
论文数:
6.5K
被引数:
1.8W

机构

C
consiglio nazionale delle ricerche (cnr)
学者数:
6.2W
论文数: 5.7W
被引数: 48
引用论文

引用论文

Self-assembled silver nanoparticles in glass microstructured by poling for SERS application
err2019-10-01
err0
PREAI
errEkaterina S. Babich; Elizaveta S. Gangrskaia; Igor V. Reduto; Jérémie Béal; Alexey V. Redkov; Thomas Maurer; Andrey A. Lipovskii
err分享
err收藏
err分享
err收藏
A Hollow Tube‐on‐Tube Architecture of Carbon‐Tube‐Supported Nickel Cobalt Sulfide Nanotubes for Advanced Supercapacitors
err2017-03-23
err0
PREAI
errNannan Wang; Yanjie Wang; Shizhong Cui; Hongwei Hou; Liwei Mi; Weihua Chen
err分享
err收藏
学者 查看更多内容