arrow
Return

Mean-Field Deep Reinforcement Learning for Multi-Agent Path Finding

delete2026-03-03
delete0
PRE
AI
L
Lin Huo
J
Jianlin Mao
H
Hongjun San
R
Ruiqi Li
Z
Zhiwei Xuan
DOI:10.1109/LRA.2026.3669783delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Continuous-space multi-agent path finding (MAPF) presents severe challenges for deep reinforcement learning (DRL), as joint state–action spaces grow exponentially and fine-grained inter-agent coordination is required. Applying mean-field approximation can reduce input complexity from $\mathcal {O}(N^{2}~d)$ to $\mathcal {O}(Nd)$, but naively averaging neighbors may weaken critical local interactions, limiting planning success. To address this, we propose the Mean-Field Multi-Agent Reinforcement Pathfinding Framework (MAMFRPF), which integrates mean-field interaction compression, a dual-stream local mean-field critic, trust-region policy optimization, and a sparse-reward design. The dual-stream critic compensates for information loss caused by mean-field averaging, improving planning success by over 20 percentage points under partial observability, while training time is reduced by roughly 7%. Trust-region optimization ensures monotonic policy improvement, and the sparse-reward mechanism accelerates long-horizon credit assignment. Experiments on continuous MAPF benchmarks show that MAMFRPF outperforms strong baselines by 15% in success rate, scales with agent density, and generalizes across diverse spatial layouts.
Keywords:
Mean-field reinforcement learning
multi-agent path finding
deep reinforcement learning
coordination and scalability
continuous control

Journal

I
IEEE Robotics and Automation Letters
IF:
5.3
Papers:
1.9K
Citations:
3.9W

Organization

K
kunming university of science and technology
Scholars:
5.8K
Papers: 1.6K
Citations: 0
Cited Papers

Cited Papers

errShare
errSave
A Transfer Learning Framework for Deep Multi-Agent Reinforcement Learning
err2024-11-01
err0
PREAI
errLiu, Yi; Wu, Xiang; Bo, Yuming; Wang, Jiacun; Ma, Lifeng
errShare
errSave
Multi-Agent Pathfinding: Definitions, Variants, and Benchmarks
err2021-09-01
err0
errOAAI
errRoni Stern; Nathan Sturtevant; Ariel Felner; Sven Koenig; Hang Ma; Thayne Walker; Jiaoyang Li; Dor Atzmon; Liron Cohen; T. K. Kumar; Roman Barták; Eli Boyarski
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
researcher View more