1
Return

Modeling and Operation of Underwater Intelligent Communication Systems: A Survey of Multi-Agent Reinforcement Learning-Based Approaches

delete2026-05-04
delete0
PRE
AI
G
Guangjie Han
S
Shengchao Zhu
C
Chuan Lin
J
Jinfang Jiang
Y
Yun Hou
DOI:10.1109/COMST.2026.3689477delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
With the continuous evolution of the 6G sea-land-air integrated communication paradigm, underwater intelligent communication systems have emerged as a prominent research focus in recent years. Due to harsh environmental conditions, limited communication bandwidth, high propagation delays, and severe energy constraints, the modelling and operation of underwater intelligent communication systems face significant challenges in achieving intelligence, coordination, and sustainability. To meet the above challenges, multi-agent reinforcement learning (MARL), characterized by its decentralized and autonomous decision-making capabilities, has been regarded as a promising framework for intelligent, distributed, and adaptive coordination in such environments. Nevertheless, there is still a lack of comprehensive surveys on using MARL to optimize underwater communication networks. Therefore, this survey provides a comprehensive overview of recent advancements in applying MARL techniques to optimize underwater communication networks and bridges this gap. Specifically, we review the fundamental components of MARL and explain why it is particularly well suited for optimizing underwater networks. Then, we review MARL-based underwater applications in both static communication systems and dynamic mobile networks, including routing strategies, network security, resource allocation, MAC layer optimization, cooperative multi-robot formation, and target tracking. Furthermore, we summarize algorithmic innovations tailored to underwater communication optimization, focusing on improvements in training efficiency, robustness, and scalability. Building on these analyses, we further analyze open challenges and outline future research directions for advancing MARL-enabled underwater communication networks.
Keywords:
Underwater intelligent communication
modeling and operation
multi-agent reinforcement learning
underwater communication optimizations

Journal

I
ieee communications surveys & tutorials
IF:
0
Papers:
67
Citations:
0

Organization

S
shenyang aerospace university
Scholars:
1.1K
Papers: 389
Citations: 0
N
Northeastern University
Scholars:
2.3W
Papers: 1.5W
Citations: 3.0W
H
hohai university
Scholars:
4.7K
Papers: 2.0K
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers