.png){kind=icon}
返回
Distributed consensus-based multi-agent temporal-difference learning
.png){kind=icon}
OA
AI
DOI：10.1016/j.automatica.2023.110922.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In this paper we propose two new distributed consensus-based algorithms for temporal-difference learning in multi-agent Markov decision processes. The algorithms are of off-policy type and are aimed at linear approximation of the value function. Restricting agents' observations to local data and communications to their small neighborhoods, the algorithms consist of: (a) local updates of the parameter estimates based on either the standard TD(),) or the emphatic ETD(),) algorithm, and (b) dynamic consensus scheme implemented over a time-varying lossy communication network. The algorithms are completely decentralized, allowing efficient parallelization and applications where the agents may have different behavior policies and different initial state distributions while evaluating a common target policy. It is proved under nonrestrictive assumptions that the proposed algorithms weakly converge to the solutions of the mean ordinary differential equation (ODE) common for all the agents. It is also proved that the whole system may be stabilized by a proper choice of the network and that the parameter estimates weakly converge to consensus. Discussion is given on the asymptotic bias and variance of the estimates, on the projected forms of the proposed algorithms, as well as on restrictiveness of the adopted assumptions. Simulation results illustrate the main properties of the algorithms and provide comparisons with similar schemes.& COPY; 2023 The Author(s). Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Keyword:
REINFORCEMENT
OPTIMIZATION
NETWORKS
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
5.9
论文数:
1.2W
被引数:
5.9W
机构
引用论文
分享收藏In silico analysis of STX2a-PE15-P4A8 chimeric protein as a novel immunotoxin for cancer therapy
OAAI
OAAI分享收藏Hierarchical Fully Convolutional Network for Joint Atrophy Localization and Alzheimer's Disease Diagnosis Using Structural MRI使用结构MRI进行关节萎缩定位和阿尔茨海默氏病诊断的分层完全卷积网络OAAI
OAAI分享收藏Distributed time synchronization for networks with random delays and measurement noise.png)
AUTOMATICAOAAI
AUTOMATICAIF5.9
OAAI分享收藏
查看更多内容