.png){kind=icon}
返回
Dynamic programming equations for discounted constrained stochastic control
.png){kind=icon}
PRE
AI
DOI：10.1109/TAC.2004.826725.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this paper, the application of the dynamic programming approach to constrained stochastic control problems with expected value constraints is demonstrated. Specifically, two such problems are analyzed using this approach. The problems analyzed are the problem of minimizing a discounted cost infinite horizon expectation objective subject to an identically structured constraint, and the problem of minimizing a discounted cost infinite horizon minimax objective subject to a discounted expectation constraint. Using the dynamic programming approach, optimality equations, which are the chief contribution of this paper, are obtained for these problems. In particular, the dynamic programming operators for problems with expectation constraints differ significantly from those of standard dynamic programming and problems with worst-case constraints. For the discounted cost infinite horizon cases, existence and uniqueness of solutions to the dynamic programming equations are explicitly shown by using the Banach fixed point theorem to show that the corresponding dynamic programming operators are contractions. The theory developed is illustrated by numerically solving the constrained stochastic control dynamic programming equations derived for simple example problems. The example problems are based on a two-state Markov model that represents an error prone system that is to be maintained.
Keyword:
constrained Markov decision processes
dynamic programming
pure policies
stochastic control
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7
论文数:
1.3W
被引数:
6.7W
机构
暂无机构信息
引用论文
Non-invasive monitoring of diabetes through analysis of the exhaled breath condensate (aerosol)
PREAI
分享收藏
Genetic Engineering and Human Mental Ecology: Interlocking Effects and Educational Considerations.png)
Biosemiotics
OAAI
BiosemioticsIF0
OAAI分享收藏Factors controlling the photoresponse of copper(i) diimine dyes containing hole-transporting dendrons in dye-sensitized solar cells: substituent and solvent effectsRSC Adv.OAAI
RSC Adv.IF0
OAAI分享收藏
查看更多内容