arrow
返回

Exploiting Partial Observability for Optimal Deception

delete2022-01-01
delete1
PRE
AI
M
Mustafa O. Karabag *
M
Melkior Ornik
U
Ufuk Topcu
DOI:10.1109/TAC.2022.3209959delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deception is a useful tool in situations where an agent operates in the presence of its adversaries. We consider a setting where a supervisor provides a reference policy to an agent, expects the agent to operate in an environment by following the reference policy, and partially observes the agent's behavior. The agent instead follows a different deceptive policy to achieve a different task. We model the environment with a Markov decision process and study the synthesis of optimal deceptive policies under partial observability. We formalize the notion of deception as a hypothesis testing problem and show that the synthesis of optimal deceptive policies is nondeterministic polynomial-time hard (NP-hard). As an approximation, we consider the class of mixture policies, which provides a convex optimization formulation of the deception problem. We give an algorithm that converges to the optimal mixture policy. We also consider a special class of Markov decision processes where the transition and observation functions are deterministic. For this case, we give a randomized algorithm for path planning that generates a path for the agent in polynomial time and achieves the optimal value for the considered objective function.
Keyword:
Index Terms-Computational complexity
deception under par-tial observations
Markov decision processes (MDPs)

期刊

IEEE Transactions on Automatic Control 封面图
IEEE Transactions on Automatic Control
IF:
7
论文数:
1.3W
被引数:
6.7W

机构

U
University of Illinois Urbana-Champaign
学者数:
2.4W
论文数: 2.0W
被引数: 35
U
university of texas austin
学者数:
2.4W
论文数: 2.0W
被引数: 54
U
university of texas system
学者数:
18.5W
论文数: 15.6W
被引数: 210
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Ring expansion and equilibration in organophosphazenes and the relationship to polymerization
err2002-05-01
err0
PREAI
errHarry R. Allcock; Gayann S. McDonnell; James L. Desorcie
err分享
err收藏
Metathesis as a versatile tool in oleochemistry
err2008-09-18
err0
PREAI
errAnastasiya Rybak; Patrice A. Fokou; Michael A. R. Meier
err分享
err收藏
学者 查看更多内容