HyperComm: Hypergraph-based communication in multi-agent reinforcement learning

doi:10.1016/j.neunet.2024.106432

Return

HyperComm: Hypergraph-based communication in multi-agent reinforcement learning

2024-10-01

PRE

DOI：10.1016/j.neunet.2024.106432

Original

Original request for help

Save

Abstract

En 中文

In the realm of fully cooperative multi -agent reinforcement learning (MARL), effective communication can induce implicit cooperation among agents and improve overall performance. In current communication strategies, agents are allowed to exchange local observations or latent embeddings, which can augment individual local policy inputs and mitigate uncertainty in local decision -making processes. Unfortunately, in previous communication schemes, agents may potentially receive irrelevant information, which increases training difficulty and leads to poor performance in complex settings. Furthermore, most existing works lack the consideration of the impact of small coalitions formed by agents in the multi -agent system. To address these challenges, we propose HyperComm , a novel framework that uses the hypergraph to model the multiagent system, improving the accuracy and specificity of communication among agents. Our approach brings the concept of hypergraph for the first time in multi -agent communication for MARL. Within this framework, each agent can communicate more effectively with other agents within the same hyperedge, leading to better cooperation in environments with multiple agents. Compared to those state-of-the-art communication -based approaches, HyperComm demonstrates remarkable performance in scenarios involving a large number of agents.

Keywords:

Multi-agent reinforcement learning (MARL)

Graph neural networks (GNNs)

Multi-agent communication

Centralized training with decentralized execution (CTDE)

execution (CTDE)

Multi-agent system