.png){kind=icon}
返回
Offloading dependent tasks in multi-access edge computing: A multi-objective reinforcement learning approach
.png){kind=icon}
PRE
AI
DOI：10.1016/j.future.2021.10.013.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This paper studies the problem of offloading an application consisting of dependent tasks in multi-access edge computing (MEC). This problem is challenging because multiple conflicting objectives exist, e.g., the completion time, energy consumption, and computation overhead should be optimized simultaneously. Recently, some reinforcement learning (RL) based methods have been proposed to address the problem. However, these methods, called single-objective RLs (SORLs), define the user utility as a linear scalarization. The conflict between objectives has been ignored. This paper formulates a multi-objective optimization problem to simultaneously minimize the application completion time, energy consumption of the mobile device, and usage charge for edge computing, subject to dependency constraints. Moreover, the relative importance (preferences) between the objectives may change over time in MEC, making it quite challenging for traditional SORLs to handle. To overcome this, we first model a multi-objective Markov decision process, where the scalar reward is extended to a vector-valued reward. Each element in the reward corresponds to one of the objectives. Then, we propose an improved multi-objective reinforcement learning (MORL) algorithm, where a tournament selection scheme is designed to select important preferences to effectively maintain previously learned policies. The simulation results demonstrate that the proposed algorithm obtains a good tradeoff between three objectives and has significant performance improvement compared with a number of existing algorithms. (C) 2021 Elsevier B.V. All rights reserved.
Keyword:
Computation offloading
Dynamic preferences
Multi-access edge computing
Multi-objective reinforcement learning
Task dependency
期刊
F
IF:
6.1
论文数:
6.9K
被引数:
2.3W
机构
引用论文
分享收藏Study of bi-directional buck-boost converter topologies for application in electrical vehicle motor drives应用于电动汽车电机驱动的双向buck-boost变换器拓扑研究
PREAI
分享收藏分享收藏分享收藏Inhibition of Ran Guanosine Triphosphatase-Dependent Nuclear Transport by the Matrix Protein of Vesicular Stomatitis Virus水泡性口炎病毒的基质蛋白抑制Ran鸟苷三磷酸酶依赖性核转运.png)
Science
ScienceIF0
PREAI
分享收藏分享收藏
查看更多内容