1
Return

Multi-Agent Reinforcement Learning for Cooperative Manipulation in Industrial Robotics: A Systematic Review of Trends, Gaps and Research Drivers

delete2026-08-13
delete0
delete
OA
AI
F
Francisco Javier Huertos *
O
Oihane Bañales
P
Pedro Álvarez
I
Itziar Cabanes
DOI:10.3390/robotics15080156delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Modern manufacturing faces increasing demands for flexibility, customization, and productivity under dynamic conditions. Multi-robot systems offer a promising solution by enabling cooperative execution of complex tasks, such as assembly and cooperative manipulation. In this context, Multi-Agent Reinforcement Learning (MARL) has emerged as a promising paradigm to enhance coordination and adaptability in industrial settings. MARL enables multiple agents to learn and interact in shared environments to achieve common goals within complex and dynamic industrial processes. In this paper, a deep analysis of MARL applied to industrial multi-robot systems based on a systematic review is presented, with particular focus on cooperative manipulation tasks. Following PRISMA guidelines, we analyze a total of 30 articles published between 2016 and 2026, selected independently by two of the authors from an initial pool of 102 records retrieved from Scopus and Web of Science. These articles were used to address five key questions regarding MARL algorithms, control architectures, industrial applications and validation practices. These research questions seek to examine gaps and trends at the research level which are important for the development of multi-agent control technologies. This review shows a clear prevalence of model-free algorithms under Centralized Training with Decentralized Execution (CTDE) architectures, with validation mainly performed in simulation. Despite promising results and high potential for impact, critical gaps remain in scalability, reproducibility, and sim-to-real transfer, limiting real deployment in manufacturing environments. To address these challenges and fill current gaps, we outline actionable research directions, such as hybrid MARL approaches, standardized industrial benchmarks, digital twin pipelines, and safety-aware deployment strategies, to accelerate MARL adoption in industrial environments.
Keywords:
industrial robotics
multi-agent systems
multi-robot coordination
reinforcement learning

Journal

Robotics cover
Robotics
IF:
3.3
Papers:
408
Citations:
3.3K

Organization

B
basque research and technology alliance
Scholars:
212
Papers: 66
Citations: 0
U
University of the Basque Country UPV/EHU
Scholars:
297
Papers: 132
Citations: 1
Cited Papers

Cited Papers

Citing Papers

Citing Papers