.png){kind=icon}
返回
Federated Multiagent Actor-Critic Learning for Age Sensitive Mobile-Edge Computing
.png){kind=icon}
OA
AI
DOI：10.1109/JIOT.2021.3078514.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
As an emerging technique, mobile-edge computing (MEC) introduces a new scheme for various distributed communication-computing systems, such as industrial Internet of Things (IoT), vehicular communication, smart city, etc. In this work, we mainly focus on the timeliness of the MEC systems where the freshness of the data and computation tasks is significant. First, we formulate a kind of age-sensitive MEC models and define the average Age-of-Information (AoI) minimization problems of interests. Then, a novel mixed-policy-based multimodal deep reinforcement learning (RL) framework, called heterogeneous multiagent actor-critic (H-MAAC), is proposed as a paradigm for joint collaboration in the investigated MEC systems, where edge devices and center controller learn the interactive strategies through their own observations. To improve the system performance, we develop the corresponding online algorithm by introducing the edge federated learning mode into the multiagent cooperation whose advantages on learning convergence can be guaranteed theoretically. To the best of our knowledge, it is the first joint MEC collaboration algorithm that combines the edge federated mode with the multiagent actor-critic RL. Furthermore, we evaluate the proposed approach and compare it with popular RL-based methods. As a result, the proposed algorithm not only outperforms the baselines on average system age, but also promotes the stability of training process. Besides, the simulation outcomes provide several insights for collaboration designs over MEC systems.
Keyword:
Collaboration
Reinforcement learning
Task analysis
Computational modeling
Distributed databases
Edge computing
Data models
Federated learning (FL)
joint collaboration
mixed policies
mobile-edge computing (MEC)
multiagent deep reinforcement learning (RL)
multimodal learning
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
1.4W
被引数:
7.8W
机构
引用论文
Apatinib and fractionated stereotactic radiotherapy for the treatment of limited brain metastases from primary lung mucoepidermoid carcinoma.png)
MedicineOAAI
MedicineIF0
OAAI分享收藏Critical Evaluation and Thermodynamic Optimization of the Li2O-Al2O3 and Li2O-MgO-Al2O3 Systems
PREAI
分享收藏Smart Resource Allocation for Mobile Edge Computing: A Deep Reinforcement Learning Approach移动边缘计算的智能资源分配: 一种深度强化学习方法
PREAI
分享收藏分享收藏
查看更多内容