arrow
返回

Practical solution techniques for first-order MDPs

delete2009-04-01
delete62
delete
OA
AI
S
Scott Sanner *
C
Craig Boutilier
DOI:10.1016/j.artint.2008.11.003delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Many traditional solution approaches to relationally specified decision-theoretic planning problems (e.g., those stated in the probabilistic planning domain description language, or PPDDL) ground the specification with respect to a specific instantiation of domain objects and apply a solution approach directly to the resulting ground Markov decision process (MDP). Unfortunately, the space and time complexity of these grounded solution approaches are polynomial in the number of domain objects and exponential in the predicate arity and the number of nested quantifiers in the relational problem specification. An alternative to grounding a relational planning problem is to tackle the problem directly at the relational level. In this article, we propose one such approach that translates an expressive subset of the PPDDL representation to a first-order MDP (FOMDP) specification and then derives a domain-independent policy without grounding at any intermediate step. However, such generality does not come without its own set of challenges-the purpose of this article is to explore practical solution techniques for solving FOMDPs. To demonstrate the applicability of our techniques, we present proof-of-concept results of our first-order approximate linear programming (FOALP) planner on problems from the probabilistic track of the ICAPS 2004 and 2006 International Planning Competitions. Crown Copyright (C) 2008 Published by Elsevier B.V. All rights reserved.
Keyword:
MDPs
First-order logic
Planning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Artificial Intelligence Review 封面图
Artificial Intelligence Review
IF:
13.9
论文数:
6.1K
被引数:
1.9W

机构

N
nicta
学者数:
191
论文数: 167
被引数: 0
U
university of toronto
学者数:
14.7W
论文数: 12.0W
被引数: 165