arrow
返回

Improved Double Deep Q Network-Based Task Scheduling Algorithm in Edge Computing for Makespan Optimization

delete2024-06-01
delete28
delete
OA
AI
L
Lei Zeng
Q
Qi Liu
S
Shigen Shen *
X
Xiaodong Liu
DOI:10.26599/TST.2023.9010058delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Edge computing nodes undertake an increasing number of tasks with the rise of business density. Therefore, how to efficiently allocate large-scale and dynamic workloads to edge computing resources has become a critical challenge. This study proposes an edge task scheduling approach based on an improved Double Deep Q Network (DQN), which is adopted to separate the calculations of target Q values and the selection of the action in two networks. A new reward function is designed, and a control unit is added to the experience replay unit of the agent. The management of experience data are also modified to fully utilize its value and improve learning efficiency. Reinforcement learning agents usually learn from an ignorant state, which is inefficient. As such, this study proposes a novel particle swarm optimization algorithm with an improved fitness function, which can generate optimal solutions for task scheduling. These optimized solutions are provided for the agent to pre-train network parameters to obtain a better cognition level. The proposed algorithm is compared with six other methods in simulation experiments. Results show that the proposed algorithm outperforms other benchmark methods regarding makespan.
Keyword:
edge computing
task scheduling
reinforcement learning
makespan
Double Deep Q Network (DQN)

期刊

T
Tsinghua Science and Technology
IF:
3.5
论文数:
987
被引数:
2.5K

机构

E
Edinburgh Napier University
学者数:
2.2K
论文数: 2.4K
被引数: 2.9K
H
Huzhou University
学者数:
4.1K
论文数: 3.5K
被引数: 6.7K
引用论文

引用论文

Artificial Intelligence for Edge Service Optimization in Internet of Vehicles: A Survey
err2022-04-01
err127
errOAAI
errXu, Xiaolong; Li, Haoyuan; Xu, Weijie; Liu, Zhongjian; Yao, Liang; Dai, Fei
err分享
err收藏
Seizure in isolated brain cryptococcoma: Case report and review of the literature
err2021-04-14
err0
errOAAI
errLaura Brunasso; Roberta Costanzo; Antonio Cascio; Ada Florena; Gianvincenzo Sparacia; Domenico Gerardo Iacopino; Giovanni Grasso
err分享
err收藏
Game Theory for Distributed IoV Task Offloading With Fuzzy Neural Network in Edge Computing
err2022-11-01
err92
PREAI
errXu, Xiaolong; Jiang, Qinting; Zhang, Peiming; Cao, Xuefei; Khosravi, Mohammad R.; Alex, Linss T.; Qi, Lianyong; Dou, Wanchun
err分享
err收藏
CoPace: Edge Computation Offloading and Caching for Self-Driving With Deep Reinforcement Learning
err2021-12-01
err58
errOAAI
errTian, Hao; Xu, Xiaolong; Qi, Lianyong; Zhang, Xuyun; Dou, Wanchun; Yu, Shui; Ni, Qiang
err分享
err收藏
Dynamic Thermal Features of Insulated Blocks: Actual Behavior and Myths
err2017-11-09
err0
errOAAI
errMarta Cianfrini; Roberto De Lieto Vollaro; Emanuele Habib
err分享
err收藏
学者 查看更多内容