arrow
返回

Multi-Objective Deep Reinforcement Learning for Function Offloading in Serverless Edge Computing

delete2025-01-01
delete0
PRE
AI
Y
Yaning Yang
X
Xiao Du
Y
Yutong Ye
J
Jiepin Ding
T
Ting Wang
陈
陈明松 (Ming-Song Chen) *
李克勤 封面图
李克勤 (Keqin Li)
DOI:10.1109/TSC.2024.3489443delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Function offloading problems play a crucial role in optimizing the performance of applications in serverless edge computing (SEC). Existing research has extensively explored function offloading strategies based on optimizing a single objective. However, a significant challenge arises when users expect to optimize multiple objectives according to the relative importance of these objectives. This challenge becomes particularly pronounced when the relative importance of the objectives dynamically shifts. Consequently, there is an urgent need for research into multi-objective function offloading methods. In this paper, we redefine the SEC function offloading problem as a dynamic multi-objective optimization issue and propose a novel approach based on Multi-objective Reinforcement Learning (MORL) called MOSEC. MOSEC can coordinately optimize three objectives, i.e., application completion time, User Device (UD) energy consumption, and user cost. To reduce the impact of extrapolation errors, MOSEC integrates a Near-on Experience Replay (NER) strategy during the model training. Furthermore, MOSEC adopts our proposed Earliest First (EF) scheme to maintain the policies learned previously, which can efficiently mitigate the catastrophic policy forgetting problem. Extensive experiments conducted on various generated applications demonstrate the superiority of MOSEC over state-of-the-art multi-objective optimization algorithms.
Keyword:
Servers
Optimization
Energy consumption
Costs
Edge computing
Heuristic algorithms
Vectors
Serverless computing
Computational modeling
Wireless communication
Serverless edge computing
function offloading
multi-objective optimization
deep reinforcement learning

期刊

IEEE Transactions on Services Computing 封面图
IEEE Transactions on Services Computing
IF:
5.8
论文数:
2.2K
被引数:
6.5K

机构

E
east china normal university
学者数:
3.1W
论文数: 2.1W
被引数: 25
S
state university of new york (suny) system
学者数:
6.5W
论文数: 5.8W
被引数: 65
引用论文

引用论文

Thymic dependence of invariant Vα14+ Natural Killer-T cell development
err1999-10-01
err0
PREAI
errFlorence Tilloy; James P. Di Santo; Albert Bendelac; Olivier Lantz
err分享
err收藏
Magnetic Properties of Mn Doped NiO
err2008-08-01
err0
PREAI
errEkaphan Swatsitang; A. Pimsawat
err分享
err收藏
Dependent Function Embedding for Distributed Serverless Edge Computing
err2022-10-01
err32
PREAI
errDeng, Shuiguang; Zhao, Hailiang; Xiang, Zhengzhe; Zhang, Cheng; Jiang, Rong; Li, Ying; Yin, Jianwei; Dustdar, Schahram; Zomaya, Albert Y.
err分享
err收藏
学者 查看更多内容