.png){kind=icon}
返回
Transfer-Entropy-Regularized Markov Decision Processes
.png){kind=icon}
OA
AI
DOI：10.1109/TAC.2021.3069347.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We consider the framework of transfer-entropy-regularized Markov decision process (TERMDP) in which the weighted sum of the classical state-dependent cost and the transfer entropy from the state random process to the control input process is minimized. Although TERMDPs are generally formulated as nonconvex optimization problems, an analytical necessary optimality condition can be expressed as a finite set of nonlinear equations, based on which an iterative forward-backward computational procedure similar to the Arimoto-Blahut algorithm is developed. It is shown that every limit point of the sequence generated by the proposed algorithm is a stationary point of the TERMDP. Applications of TERMDPs are discussed in the context of networked control systems theory and nonequilibrium thermodynamics. The proposed algorithm is applied to an information-constrained maze navigation problem, whereby we study how the price of information qualitatively alters the optimal decision polices.
Keyword:
Entropy
Random processes
Standards
Markov processes
Thermodynamics
Rate-distortion
Optimization
Directed information
Markov decision process
networked control systems
rate-distortion theory
thermodynamics
transfer entropy
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7
论文数:
1.3W
被引数:
6.7W
机构
引用论文
Rational design, synthesis and activities of phenanthrene derivatives against hepatic fibrosis.png)
Fitoterapia
FitoterapiaIF0
PREAI
分享收藏分享收藏
查看更多内容