arrow
Return

Collaborative Learning-Based Scheduling for Kubernetes-Oriented Edge-Cloud Network

delete2023-12-01
delete2
delete
OA
AI
S
Shihao Shen
Y
Yiwen Han
X
Xiaofei Wang *
S
Shiqiang Wang
V
Victor C. M. Leung
DOI:10.1109/TNET.2023.3267168delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Kubernetes (k8s) has the potential to coordinate distributed edge resources and centralized cloud resources, but currently lacks a specialized scheduling framework for edge-cloud networks. Besides, the hierarchical distribution of heterogeneous resources makes the modeling and scheduling of k8s-oriented edge-cloud network particularly challenging. In this paper, we introduce KaiS, a learning-based scheduling framework for such edge-cloud network to improve the long-term throughput rate of request processing. First, we design a coordinated multi agent actor-critic algorithm to cater to decentralized request dispatch and dynamic dispatch spaces within the edge cluster. Second, for diverse system scales and structures, we use graph neural networks to embed system state information, and combine the embedding results with multiple policy networks to reduce the orchestration dimensionality by stepwise scheduling. Finally, we adopt a two-time-scale scheduling mechanism to harmonize request dispatch and service orchestration, and present the implementation design of deploying the above algorithms compatible with native k8s components. Experiments using real workload traces show that KaiS can successfully learn appropriate scheduling policies, irrespective of request arrival patterns and system scales. Moreover, KaiS can enhance the average system throughput rate by 15.9% while reducing scheduling cost by 38.4% compared to baselines.
Keywords:
Cloud computing
Heuristic algorithms
Throughput
IEEE transactions
Clustering algorithms
Dynamic scheduling
Computational modeling
Edge computing
kubernetes
reinforcement learning
scheduling algorithms

Journal

I
IEEE-ACM Transactions on Networking
IF:
3.6
Papers:
4.4K
Citations:
9.5K

Organization

T
tianjin university
Scholars:
8.0W
Papers: 5.8W
Citations: 88
I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
I
ibm usa
Scholars:
1.4K
Papers: 1.0K
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Succinylated copper, zinc superoxide dismutase. A novel approach to the problem of active subunits
err2002-05-01
err0
PREAI
errFranco Marmocchi; Irene Mavelli; Adelio Rigo; Roberto Stevanato; Francesco Bossa; Giuseppe Rotilio
errShare
errSave
Prevention of type I diabetes in NOD mice by adjuvant immunotherapy
err1990-05-01
err0
PREAI
errM. W. Sadelain; H. Y. Qin; J. Lauzon; B. Singh
errShare
errSave
Mini‐Mental State Examination
err2002-04-30
err0
PREAI
errJoseph R. Cockrell; Marshal F. Folstein
errShare
errSave
Convergence of Edge Computing and Deep Learning: A Comprehensive Survey
err2020-01-01
err812
errOAAI
errWang, Xiaofei; Han, Yiwen; Leung, Victor C. M.; Niyato, Dusit; Yan, Xueqiang; Chen, Xu
errShare
errSave
Deep Learning on Graphs: A Survey
err2022-01-01
err385
errOAAI
errZhang, Ziwei; Cui, Peng; Zhu, Wenwu
errShare
errSave
FishFace: interactive atlas of zebrafish craniofacial development at cellular resolution
err2013-05-28
err0
errOAAI
errB Frank Eames; April DeLaurier; Bonnie Ullmann; Tyler R Huycke; James T Nichols; John Dowd; Marcie McFadden; Mark M Sasaki; Charles B Kimmel
errShare
errSave
researcher View more