Cache-Aided MEC for IoT: Resource Allocation Using Deep Graph Reinforcement Learning

Dan Wang

doi:10.1109/JIOT.2023.3244909

Cache-Aided MEC for IoT: Resource Allocation Using Deep Graph Reinforcement Learning

2023-07-01

20

PRE

AI

DOI：10.1109/JIOT.2023.3244909

Original

Original request for help

Save

Abstract

En 中文

With the growing demand for latency-sensitive and compute-intensive services in the Internet of Things (IoT), multiaccess edge computing (MEC)-enabled IoT is envisioned as a promising technique that allows network nodes to have computing and caching capabilities. In this article, we propose a cache-aided MEC (CA-MEC) offloading framework for joint optimization of communication, computing, and caching (3C) resources in the MEC-enabled IoT. Our goal is to optimize the offloading decision and resource allocation strategy to minimize the system latency subject to dynamic cache capacities and computing resource constraints. We first formulate this optimization problem as a multiagent decision problem, a partially observable Markov decision process (POMDP). Then, the deep graph convolution reinforcement learning (DGRL) method is applied to motivate the agents to learn optimal strategies cooperatively in a highly dynamic environment. Simulations show that our method is highly effective for computation offloading and resource allocation and performs superior results in a large-scale network.

Keywords:

Computation offloading

deep reinforcement learning

graph convolutional network

Internet of Things (IoT)

multiaccess edge computing (MEC)

Cache-Aided MEC for IoT: Resource Allocation Using Deep Graph Reinforcement Learning

Abstract

Journal

Organization