.png){kind=icon}
返回
Complexity Bounds for Deterministic Partially Observed Markov Decision Processes
.png){kind=icon}
PRE
AI
DOI：10.1007/s10479-024-06282-0.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Partially Observed Markov Decision Processes (Pomdp) share the structure of Markov Decision Processs (Mdp) - with stages, states, actions, probability transitions, rewards - but for the notion of solutions. In a Pomdp, observation mappings provide partial and/or imperfect knowledge of the state, and a policy maps observations (and not states like in a Mdp) towards actions. Theroretically, a Pomdp can be solved by Dynamic Programming (DP), but with an information state made of probability distributions over the original state, hence DP suffers from the curse of dimensionality, even in the finite case. This is why, authors like (Littman, M. L. 1996). Algorithms for Sequential Decision Making. PhD thesis, Brown University) and (Bonet, B. 2009). Deterministic POMDPs revisited. In Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, UAI '09 (pp. 59-66). Arlington, Virginia, USA. AUAI Press) have studied the subclass of so-called Deterministic Partially Observed Markov Decision Processes (Det-Pomdp), where transitions and observations mappings are deterministic. In this paper, we improve on Littman's complexity bounds. We then introduce and study a more restricted class, Separated Det-Pomdps, and give some new complexity bounds for this class.
期刊
IF:
4.5
论文数:
8.1K
被引数:
2.1W
机构
引用论文
The training of verb production in Broca's aphasia: A multiple‐baseline across‐behaviours study.png)
Aphasiology
AphasiologyIF0
PREAI
分享收藏分享收藏A Pilot Study of Antithrombin Replacement Prior to Cardiopulmonary Bypass in Neonates新生儿体外循环前抗凝血酶替代的初步研究
OAAI
OAAI分享收藏Abstract 18061: Supplementation to Treat Antithrombin Deficiency Improves Sensitivity to Heparin, Anticoagulation and Decreased Thrombogenecity in Neonates and Infants Undergoing Cardiac Surgery With Cardiopulmonary Bypass摘要18061：补充治疗以改善抗凝血酶缺乏症，提高了新生儿和婴儿在体外循环心脏手术中对肝素、抗凝作用的敏感性，并降低了血栓生成性。Circulation
CirculationIF0
PREAI
分享收藏
没有更多内容
没有更多内容