1
Return

Learning to Control Unknown Strongly Monotone Games

delete2026-03-10
delete0
PRE
AI
S
Siddharth Chandak
I
Ilai Bistritz
N
Nicholas Bambos
DOI:10.1109/tcns.2026.3672682delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Consider a strongly monotone game where the players’ utility functions include a reward function and a linear term for each dimension, with coefficients that are controlled by the manager. Gradient play converges to a unique Nash equilibrium (NE) that does not optimize the global objective. The global performance at the NE can be improved by imposing linear constraints on the NE, also known as a generalized Nash equilibrium (GNE). We, therefore, want the manager to control the coefficients such that they impose the desired constraint on the NE. However, this requires knowing the players’ rewards and action sets. Obtaining this game information is infeasible in a large-scale network and violates user privacy. To overcome this, we propose a simple algorithm that learns to shift the NE to meet the linear constraints by adjusting the controlled coefficients online. Our algorithm only requires the linear constraints violation as feedback and does not need to know the reward functions or the action sets. We prove that our algorithm converges with probability 1 to the set of GNE given by coupled linear constraints. We then prove an L2 convergence rate of near-<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$O(t^{-1/4})$</tex-math></inline-formula>.
Keywords:
Game theory
distributed algorithms, multi-agent systems
iterative learning control
agents and autonomous systems

Journal

IEEE Transactions on Control of Network Systems cover
IEEE Transactions on Control of Network Systems
IF:
5
Papers:
1.6K
Citations:
5.8K

Organization

T
tel aviv university
Scholars:
4.8K
Papers: 1.8K
Citations: 1
S
stanford university
Scholars:
9.2K
Papers: 3.6K
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers