arrow
Return

Multi-Agent Deep Reinforcement Learning-Based Interdependent Computing for Mobile Edge Computing-Assisted Robot Teams

delete2023-05-01
delete14
PRE
AI
Q
Qimei Cui *
赵奚誉 cover
赵奚誉 (Xiyu Zhao)
W
Wei Ni
Z
Zheng Hu *
X
Xiaofeng Tao
张平 (Ping Zhang)
DOI:10.1109/TVT.2022.3232806delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
A group of robots can be assigned with different roles to collaboratively conduct interdependent tasks. The robots form a multi-robot system (MRS), where one robot's decision or action relies on the others'. This paper addresses the sequential decision problem of user association and resource allocation in a mobile edge computing (MEC)-enabled, wirelessly-connected MRS to maximize the time-averaged completion rate of interdependent computing tasks. The problem is challenging due to the partial observability of the network environment, and the delicate delay requirements of interdependent computing tasks. A new decentralized partially observable Markov decision process (Dec-POMDP) problem is reformulated, where edge servers act as intelligent agents and can make decentralized decisions about user association and resource management with their local information of the network state. By leveraging the multi-agent deep deterministic policy gradient (MADDPG) theory, a new cooperative multi-agent deep reinforcement learning (MADRL) model is developed to enable interdependent computing. Simulations show the merits of our approach in terms of task completion rate compared to existing techniques.
Keywords:
Robots
Task analysis
Servers
Resource management
Delays
Robot kinematics
Processor scheduling
Robot team
multi-robot system
mobile edge computing
interdependent computing
user association
resource allocation
multi-agent deep reinforcement learning

Journal

IEEE Transactions on Vehicular Technology cover
IEEE Transactions on Vehicular Technology
IF:
7.1
Papers:
1.8W
Citations:
6.6W

Organization

B
beijing university of posts & telecommunications
Scholars:
1.4W
Papers: 1.2W
Citations: 9