arrow
Return

Dynamic Social Learning Under Graph Constraints

delete2022-09-01
delete3
delete
OA
AI
K
Konstantin Avrachenkov
V
Vivek S. Borkar *
S
Sharayu Moharir
S
Suhail M. Shah
DOI:10.1109/TCNS.2021.3114377delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We introduce a model of graph-constrained dynamic choice with reinforcement modeled by positively alpha-homogeneous rewards. We show that its empirical process, which can be written as a stochastic approximation recursion with Markov noise, has the same probability law as a certain vertex reinforced random walk. We use this equivalence to show that for alpha > 0, the asymptotic out- come concentrates around the optimum in a certain limiting sense when annealed by letting alpha up arrow infinity slowly.
Keywords:
Annealed dynamics
dynamic choice with reinforcement
graphical constraints
optimal choice
vertex reinforced random walk

Journal

IEEE Transactions on Control of Network Systems cover
IEEE Transactions on Control of Network Systems
IF:
5
Papers:
1.6K
Citations:
5.8K

Organization

I
indian institute of technology (iit) - bombay
Scholars:
6.0K
Papers: 5.6K
Citations: 0
I
indian institute of technology system (iit system)
Scholars:
9.5W
Papers: 9.9W
Citations: 93