arrow
返回

Distributed Markov Chain Redesign for Multiagent Decision-Making Problems

delete2023-02-01
delete1
PRE
AI
G
Gabriele Oliva *
R
Roberto Setola
A
Andrea Gasparri
DOI:10.1109/TAC.2022.3170333delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this article, we consider the problem of modifying in a distributed way the transition probabilities of a Markov chain over an undirected graph in order to achieve a desired limiting distribution, while minimizing the variation from the current weights. This problem setting could be used to model a (graph-based) distributed decision-making process where static agents, e.g., elements of Internet of Things (IoT) networks, are required to achieve a common objective while adapting to different operational conditions, e.g., monitoring of time-varying and spatial-varying phenomena. This could be effectively used to describe several applications settings, ranging from sensor-network-based border patrolling to IoT-based environmental precision farming. In this context, our contribution is threefold: 1) we show that, under the assumption that a global optimal solution exists, then such a solution can be computed by solving a relaxed problem, where the irreducibility and aperiodicity constraints are lifted; 2) we derive an algebraic optimality condition for the relaxed problem; and 3) we design a distributed algorithm that provably converges towards this optimality condition.
Keyword:
Markov processes
Limiting
Decision making
Monitoring
Proposals
Employee welfare
Distributed algorithms
Distributed decision-making
distributed optimization
Markov chains

期刊

IEEE Transactions on Automatic Control 封面图
IEEE Transactions on Automatic Control
IF:
7
论文数:
1.3W
被引数:
6.7W

机构

R
Roma Tre University
学者数:
5.1K
论文数: 4.9K
被引数: 5.4K
U
university campus bio-medico - rome italy
学者数:
6.0K
论文数: 4.6K
被引数: 4
引用论文

引用论文

Prognostic utility of comparative methods for assessment of ST-segment resolution after primary angioplasty for acute myocardial infarction
err2004-09-01
err0
errOAAI
errMichael G. McLaughlin; Gregg W. Stone; Eve Aymong; Graham Gardner; Roxana Mehran; Alexandra J. Lansky; Cindy L. Grines; James E. Tcheng; David A. Cox; Thomas Stuckey; Eulogio Garcia; Giulio Guagliumi; Mark Turco; Mark E. Josephson; Peter Zimetbaum
err分享
err收藏
A visible light-driven plasmonic photocatalyst
err2014-01-17
err0
errOAAI
errFrancesca Pincella; Katsuhiro Isozaki; Kazushi Miki
err分享
err收藏
Markov Chain Lifting and Distributed ADMM
err2017-03-01
err8
errOAAI
errFranca, Guilherme; Bento, Jose
err分享
err收藏
Distributed Flow Network Balancing With Minimal Effort
err2019-09-01
err7
PREAI
errOliva, Gabriele; Rikos, Apostolos I.; Hadjicostis, Christoforos N.; Gasparri, Andrea
err分享
err收藏
Effect of painful Ledderhose disease on dynamic plantar foot pressure distribution during walking: a case-control study
err2023-09-01
err0
errOAAI
errAnneke de Haan; Juha M. Hijmans; Anna E. van der Vegt; Hans Paul van der Laan; Johanna G.H. van Nes; Paul M.N. Werker; Johannes A. Langendijk; Roel J.H.M. Steenbakkers
err分享
err收藏
学者 查看更多内容