返回
Distributed Markov Chain Redesign for Multiagent Decision-Making Problems
DOI:10.1109/TAC.2022.3170333.png)
摘要
En 中文
In this article, we consider the problem of modifying in a distributed way the transition probabilities of a Markov chain over an undirected graph in order to achieve a desired limiting distribution, while minimizing the variation from the current weights. This problem setting could be used to model a (graph-based) distributed decision-making process where static agents, e.g., elements of Internet of Things (IoT) networks, are required to achieve a common objective while adapting to different operational conditions, e.g., monitoring of time-varying and spatial-varying phenomena. This could be effectively used to describe several applications settings, ranging from sensor-network-based border patrolling to IoT-based environmental precision farming. In this context, our contribution is threefold: 1) we show that, under the assumption that a global optimal solution exists, then such a solution can be computed by solving a relaxed problem, where the irreducibility and aperiodicity constraints are lifted; 2) we derive an algebraic optimality condition for the relaxed problem; and 3) we design a distributed algorithm that provably converges towards this optimality condition.
Keyword:
Markov processes
Limiting
Decision making
Monitoring
Proposals
Employee welfare
Distributed algorithms
Distributed decision-making
distributed optimization
Markov chains
期刊
IF:
7
论文数:
1.3W
被引数:
6.7W
机构
引用论文
The physiological effects of cigarette smoking: Implications for psychophysiological research吸烟的生理效应: 对心理生理学研究的启示
Effect of painful Ledderhose disease on dynamic plantar foot pressure distribution during walking: a case-control study
The Foot
IF0

