arrow
返回

Reinforcement learning-based task scheduling for heterogeneous computing in end-edge-cloud environment

delete2025-01-21
delete0
PRE
AI
W
Wangbo Shen
林伟伟 封面图
林伟伟 (Weiwei Lin) *
W
Wentai Wu
H
Haijie Wu
李克勤 封面图
李克勤 (Keqin Li)
DOI:10.1007/s10586-024-04828-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The End-Edge-Cloud (EEC) computing framework can offer low-latency, high-quality services to users of diverse demands by leveraging pervasive resources. However, the inherent disparities in task requirements and the strong heterogeneity of computational resources in these systems make it non-trivial for scheduler design, particularly in high load scenarios (e.g. burst of tasks). This also complicates the adaptation of traditional cloud-oriented schedulers considering their limited support of heterogeneous processors and accelerators (e.g., CPUs, GPUs and NPUs). In light of this, we first present a system framework for task scheduling in the EEC architecture. In the framework we adopt a reinforcement learning (RL)-based scheduler tailored for reducing task completion time and waiting time. Our method integrates task characteristics and environmental constraints within matrices, based on which an adapted Q-Learning agent is employed for decision making. We then introduce the implementation of our framework that features Kubernetes and Rancher-based coordination with extended support for heterogeneous processing units. Experimentally we built a real-world EEC testbed comprising PC, Atlas 200 DK, and Raspberry PI devices. Evaluation results of our algorithm demonstrate a 271% enhancement in performance compared to existing algorithms in the context of burst-arrival task queues, which underscores the efficacy of our solution in realistic scenarios.
Keyword:
End-Edge-Cloud computing framework
Heterogeneous computing
Machine learning
Reinforcement learning

期刊

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
论文数:
5.1K
被引数:
7.5K

机构

S
state university of new york (suny) system
学者数:
6.5W
论文数: 5.8W
被引数: 65
S
south china university of technology
学者数:
6.8W
论文数: 5.1W
被引数: 85
S
suny optometry
学者数:
92
论文数: 69
被引数: 0
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
A Survey on Evolutionary Neural Architecture Search
err2023-02-01
err255
errOAAI
errLiu, Yuqiao; Sun, Yanan; Xue, Bing; Zhang, Mengjie; Yen, Gary G.; Tan, Kay Chen
err分享
err收藏
Identification of an actin binding region in aldolase
err2001-10-29
err0
errOAAI
errGabrielle O'Reilly; Frank Clarke
err分享
err收藏
Proverb interpretation changes in aging
err2008-06-01
err0
PREAI
errJennifer Uekermann; Patrizia Thoma; Irene Daum
err分享
err收藏
Deep Reinforcement Learning for Delay-Oriented IoT Task Scheduling in SAGIN
err2021-02-01
err197
PREAI
errZhou, Conghao; Wu, Wen; He, Hongli; Yang, Peng; Lyu, Feng; Cheng, Nan; Shen, Xuemin
err分享
err收藏
学者 查看更多内容