.png){kind=icon}
返回
Federated Learning Adaptive Dynamic Programming for Massive Multiagent Mean-Field Games-Based Optimal Consensus
.png){kind=icon}
PRE
AI
DOI：10.1109/TCYB.2025.3606528.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Massive multiagent systems typically involve a very large number of interactions and conflicts of interest among agents, which presents a significant challenge for achieving stable and efficient adaptive optimal consensus control in real-time. To fill this gap, this article develops a novel federated learning adaptive dynamic programming (FL-ADP) control scheme to solve the massive multiagent mean-field games (MFGs)-based optimal consensus problem. First, the complex interactions of each individual agent with all other agents can be approximated by an average or collective influence in the context of MFGs. Then, a novel undiscounted performance index function involving the mean-field coupling term, the tracking errors and their derivatives is proposed to circumvent the potential impact of the improper discount factor selection and achieve better control performance. By designing the critic–mass neural network structure, the coupled Hamilton–Jacobi–Bellman and Fokker–Planck–Kolmogorov equations are solved to derive the approximate optimal control policy and quantify the probability density function of the collective behavior simultaneously. Additionally, to comply with the required convergence condition of the MFG, a novel event-triggered federated learning mechanism is formulated, which achieves a balance between communication resource consumption and the guarantee of algorithm convergence. On the basis of Lyapunov’s direct method, the tracking errors and the weight estimation errors of all agents are guaranteed to be uniformly ultimately bounded. Simulation results of massive multi-uncrewed aerial vehicle systems affirm the rationality and effectiveness of the proposed method.
Keyword:
Adaptive dynamic programming
massive multiagent systems
mean-field games (MFG)
optimal control
reinforcement learning
期刊
IF:
10.5
论文数:
1.1W
被引数:
5.0W
机构
引用论文
Decentralized Adaptive Tracking Control For Large-Scale Multi-Agent Systems Under Unstructured Environment大尺度多智能体系统在非结构化环境下的分布式自适应跟踪控制
PREAI
分享收藏Discounted Iterative Adaptive Critic Designs With Novel Stability Analysis for Tracking Control
PREAI
分享收藏Adaptive Resilient Event-Triggered Control Design of Autonomous Vehicles With an Iterative Single Critic Learning Framework具有迭代单批评家学习框架的自动驾驶车辆的自适应弹性事件触发控制设计
OAAI
OAAI分享收藏Fully distributed adaptive control for output consensus of uncertain discrete-time linear multi-agent systems.png)
AUTOMATICA
AUTOMATICAIF5.9
PREAI
分享收藏
Recent Progress in Reinforcement Learning and Adaptive Dynamic Programming for Advanced Control Applications用于高级控制应用的强化学习和自适应动态规划的最新进展
PREAI
分享收藏Adaptive critic design for safety-optimal FTC of unknown nonlinear systems with constrained具有约束的未知非线性系统的安全最优FTC的自适应批评家设计ISA TRANSACTIONS
ISA TRANSACTIONSIF6.5
PREAI
分享收藏
查看更多内容