arrow
Return

A deep Q-network-based edge service offloading in cloud-edge-terminal environment

delete2025-04-19
delete0
PRE
AI
曹步清 cover
曹步清 (Buqing Cao)
Y
Y. Yi
Z
Zilong Zeng *
B
Bing Tang
DOI:10.1007/s11227-025-07228-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The advancement of mobile edge computing enables edge devices to efficiently utilize resources through optimized scheduling, providing robust computational support for diverse service requests. However, mobile intelligent terminals have limited computational resources and often rely on edge servers for task processing. Each edge server, in turn, has finite resources, necessitating task offloading to other servers when resource demand exceeds availability. This process aims to improve the efficiency of the response of the service. However, edge devices tend to prioritize their own performance, often neglecting load balancing across servers. To address this issue, this paper proposes a deep reinforcement learning-based method for offloading edge services in mobile edge environments. The method considers both the offloading demands of mobile terminals and the service reception capacities of edge servers to achieve efficient offloading, load balancing, and reduced communication delay. Initially, offloading demands and the reception capabilities of idle edge servers are mathematically modeled. The offloading scenario is then framed as an optimization problem involving multiple objectives and subject to various constraints. Finally, deep reinforcement learning is applied to construct a Markov decision process for iterative optimization, resulting in low-delay and balanced offloading solutions. The experimental results show that, compared with the baseline methods such as Random, Top-K, K-means, PSO, and Q-learning, the method proposed in this paper has achieved improvements of 30.85%, 17.42%, 12.69%, 22.32%, and 11.64% respectively in terms of the load standard deviation. This successfully verifies the effectiveness of the method proposed in this paper.
Keywords:
Edge computing
Service offloading
Reinforcement learning
DQN

Journal

Journal of Supercomputing cover
Journal of Supercomputing
IF:
2.7
Papers:
1.0K
Citations:
1.0W

Organization

H
Hunan Univ Sci and Technol
Scholars:
629
Papers: 265
Citations: 63
H
Hunan Univ Technol
Scholars:
321
Papers: 118
Citations: 64
G
Guangzhou Maritime University
Scholars:
834
Papers: 762
Citations: 17
researcher View more organizations