Multiagent Low-Dimensional Linear Bandits

Ronshee Chawla

doi:10.1109/TAC.2022.3179521

Multiagent Low-Dimensional Linear Bandits

2023-05-01

1

OA

AI

DOI：10.1109/TAC.2022.3179521

Original

Original request for help

Save

Abstract

En 中文

We study a multiagent stochastic linear bandit with side information, parameterized by an unknown vector 0(*) ? R-d. The side information consists of a finite collection of low-dimensional subspaces, one of which contains 0(*). In our setting, agents can collaborate to reduce regret by sending recommendations across a communication graph connecting them. We present a novel decentralized algorithm, where agents communicate subspace indices with each other and each agent plays a projected variant of LinUCB on the corresponding (low dimensional) subspace. By distributing the search for the optimal subspace across users and learning of the unknown vector by each agent in the corresponding low-dimensional subspace, we show that the per-agent finite-time regret is much smaller than the case when agents do not communicate. We finally complement these results through simulations.

Keywords:

Collaboration

Servers

Stochastic processes

Sparse matrices

Advertising

Postal services

Information sharing

Decentralized learning

gossip

linear bandits

networks

regret minimization

Multiagent Low-Dimensional Linear Bandits

Abstract

Journal

Organization