返回
Max-plus approximation for reinforcement learning
DOI:10.1016/j.automatica.2021.109623.png)
摘要
En 中文
Max-Plus Algebra has been applied in several contexts, especially in the control of discrete events systems. In this article, we discuss another application closely related to control: the use of Max-Plus algebra concepts in the context of reinforcement learning. Max-Plus Algebra and reinforcement learning are strongly linked due to the latter's dependence on the Bellman Equation which, in some cases, is a linear Max-Plus equation. This fact motivates the application of Max-Plus algebra to approximate the value function, central to the Bellman Equation and thus also to reinforcement learning. This article proposes conditions so that this approach can be done in a simple way and following the philosophy of reinforcement learning: explore the environment, receive the rewards and use this information to improve the knowledge of the value function. The proposed conditions are related to two matrices and impose on them a relationship that is analogous to the concept of weak inverses in traditional algebra. (C) 2021 Elsevier Ltd. All rights reserved.
Keyword:
Max-Plus Algebra
Reinforcement learning
Dynamic programming
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
5.9
论文数:
1.2W
被引数:
5.2W
机构
引用论文
Defect-related photoluminescence properties of as-synthesized and annealed NiO nanostructures via hydrothermal method通过水热法合成和退火的NiO纳米结构的缺陷相关的光致发光特性
On the control of max-plus linear system subject to state restriction受状态限制的max-plus线性系统的控制
AUTOMATICA
IF5.9
Max-plus (A,B)-invariant spaces and control of timed discrete-event systemsMax-plus (A,B)-不变空间和定时离散事件系统的控制
Thermal Expansion and Other Physical Properties of the Newer Infrared-Transmitting Optical Materials
没有更多内容

