.png){kind=icon}
.png){kind=icon}
Return
Multi-Objective Deep Reinforcement Learning for Function Offloading in Serverless Edge Computing
.png){kind=icon}
PRE
AI
DOI：10.1109/TSC.2024.3489443.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Function offloading problems play a crucial role in optimizing the performance of applications in serverless edge computing (SEC). Existing research has extensively explored function offloading strategies based on optimizing a single objective. However, a significant challenge arises when users expect to optimize multiple objectives according to the relative importance of these objectives. This challenge becomes particularly pronounced when the relative importance of the objectives dynamically shifts. Consequently, there is an urgent need for research into multi-objective function offloading methods. In this paper, we redefine the SEC function offloading problem as a dynamic multi-objective optimization issue and propose a novel approach based on Multi-objective Reinforcement Learning (MORL) called MOSEC. MOSEC can coordinately optimize three objectives, i.e., application completion time, User Device (UD) energy consumption, and user cost. To reduce the impact of extrapolation errors, MOSEC integrates a Near-on Experience Replay (NER) strategy during the model training. Furthermore, MOSEC adopts our proposed Earliest First (EF) scheme to maintain the policies learned previously, which can efficiently mitigate the catastrophic policy forgetting problem. Extensive experiments conducted on various generated applications demonstrate the superiority of MOSEC over state-of-the-art multi-objective optimization algorithms.
Keywords:
Servers
Optimization
Energy consumption
Costs
Edge computing
Heuristic algorithms
Vectors
Serverless computing
Computational modeling
Wireless communication
Serverless edge computing
function offloading
multi-objective optimization
deep reinforcement learning
Journal
IF:
5.8
Papers:
2.1K
Citations:
6.5K