.png){kind=icon}
返回
Task offloading in hybrid-decision-based multi-cloud computing network: a cooperative multi-agent deep reinforcement learning
.png){kind=icon}
OA
AI
DOI：10.1186/s13677-022-00372-9.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Multi-cloud computing is becoming a promising paradigm to provide abundant computation resources for Internet-of-Things (IoT) devices. For a multi-device multi-cloud network, the real-time computing requirements, frequently varied wireless channel gains and changeable network scale, make the system more dynamic. It is critical to satisfy the dynamic nature of network with different constraints of IoT devices in multi-cloud environment. In this paper, we establish a continuous-discrete hybrid decision offloading model, each device should learn to make coordinated actions, including cloud server selection, offloading ratio and local computation capacity. Therefore, both continuous-discrete hybrid decision and coordination among IoT devices are challenging. To this end, we first develop a probabilistic method to relax the discrete action (e.g. cloud server selection) to a continuous set. Then, by leveraging a centralized training and distributed execution strategy, we design a cooperative multi-agent deep reinforcement learning (CMADRL) based framework to minimize the total system cost in terms of the energy consumption of IoT device and the renting charge of cloud servers. Each IoT device acts as an agent, which not only learns efficient decentralized policies, but also relieves IoT devices' computing pressure. Experimental results demonstrate that the proposed CMADRL could efficiently learn dynamic offloading polices at each IoT device, and significantly outperform the four state-of-the-art DRL based agents and two heuristic algorithms with lower system cost.
Keyword:
Computation offloading
Continuous-discrete hybrid decision
Deep reinforcement learning
Internet of Things
Multi-cloud computing
期刊
J
IF:
4.3
论文数:
768
被引数:
2.2K
机构
引用论文
Dynamic task offloading for Internet of Things in mobile edge computing via deep reinforcement learning基于深度强化学习的移动边缘计算物联网动态任务卸载
.png){kind=icon}
PREAI
分享收藏Distributed Multi-Cloud Multi-Access Edge Computing by Multi-Agent Reinforcement Learning基于多Agent强化学习的分布式多云多接入边缘计算
OAAI
OAAI分享收藏分享收藏分享收藏
查看更多内容