返回
Low-discrepancy sampling for approximate dynamic programming with local approximators
DOI:10.1016/j.cor.2013.09.006.png)
摘要
En 中文
Approximate dynamic programming (ADP) relies, in the continuous-state case, on both a flexible class of models for the approximation of the value functions and a smart sampling of the state space for the numerical solution of the recursive Bellman equations. In this paper, low-discrepancy sequences, commonly employed for number-theoretic methods, are investigated as a sampling scheme in the ADP context when local models, such as the Nadaraya Watson (NW) ones, are employed for the approximation of the value function. The analysis is carried out both from a theoretical and a practical point of view. In particular, it is shown that the combined use of low-discrepancy sequences and NW models enables the convergence of the ADP procedure. Then, the regular structure of the low-discrepancy sampling is exploited to derive a method for automatic selection of the bandwidth of NW models, which yields a significant saving in the computational effort with respect to the standard cross validation approach. Simulation results concerning an inventory management problem are presented to show the effectiveness of the proposed techniques. (C) 2013 Elsevier Ltd. All rights reserved.
Keyword:
Approximate dynamic programming
Low-discrepancy sampling
Local approximation
Nadaraya-Watson models
Inventory forecasting
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
C
IF:
4.3
论文数:
6.5K
被引数:
1.8W
机构
引用论文
Effect of Recycling on the Mechanical, Thermal and Rheological Properties of Polypropylene/Carbon Nanotube Composites
Polymers
IF0
A Hollow Tube‐on‐Tube Architecture of Carbon‐Tube‐Supported Nickel Cobalt Sulfide Nanotubes for Advanced Supercapacitors
ChemNanoMat
IF0
Dreidimensionale Charakterisierung der Kornform und Scharfkantigkeit von Gesteinskörnungen mittels Röntgen-Computertomographie/3D characterisation of the grain sphericity and angularity with the aid of computed tomography
Bauingenieur
IF0
Kernel smoothers: An overview of curve estimators for the first graduate course in nonparametric statistics
STATISTICAL SCIENCE
IF3.4

