arrow
返回

Improved DDPG Based Two-Timescale Multi-Dimensional Resource Allocation for Multi-Access Edge Computing Networks

delete2024-06-01
delete2
PRE
AI
Q
Qianqian Liu
H
Haixia Zhang *
张欣 封面图
张欣 (Xin Zhang)
D
Dongfeng Yuan
DOI:10.1109/TVT.2024.3360943delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Due to the dependence of task processing on the task-related models and databases, edge service caching and multi-access edge computing (MEC) are tightly coupled. The service caching placement, offloading and resource allocation have become the key to guarantee the latency and computing requirements of tasks. However, much of the existing work is based on unrealistic assumptions that caching and other resources can be scheduled simultaneously, which lead to frequent cache switching and high system overhead. To address this, we propose a two-timescale multi-dimensional resource optimization scheme based on a Markov decision process (MDP), which jointly optimizes the long-term service caching and short-term task offloading, computing, and bandwidth resource allocation to minimize the long-term system delay and cache cost. To accommodate the two-timescale characteristics, we propose a centralized dual-actor deep deterministic policy gradient (DDPG) algorithm, where there is a dual-actor network producing both long-term and short-term resource management decisions, and a centralized critic network directing joint actions. Such a structure strengthens the learning process, enabling the dual-actor network to generate different timescale decisions that align with consistent objectives. Simulation results show that the proposed algorithm can reduce delay and cache cost compared to the existing scheme.
Keyword:
Task analysis
Resource management
Computational modeling
Costs
Delays
Optimization
Bandwidth
Service caching
multi-dimensional resources allocation
multi-access edge computing
two-timescale
centralized dual-actor deep deterministic policy gradient

期刊

IEEE Transactions on Vehicular Technology 封面图
IEEE Transactions on Vehicular Technology
IF:
7.1
论文数:
1.8W
被引数:
6.6W

机构

S
shandong university
学者数:
9.5W
论文数: 6.4W
被引数: 94
引用论文

引用论文

Spontaneous self-assembly of Cu2O@PPy nanowires and anisotropic crystals
err2009-01-01
err0
PREAI
errDavid Muñoz-Rojas; Judith Oró-Solé; Pedro Gómez-Romero
err分享
err收藏
err分享
err收藏
Pricing-Driven Service Caching and Task Offloading in Mobile Edge Computing
err2021-07-01
err83
errOAAI
errYan, Jia; Bi, Suzhi; Duan, Lingjie; Zhang, Ying-Jun Angela
err分享
err收藏
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容