arrow
返回

A Kubernetes-based scheme for efficient resource allocation in containerized workflow

delete2025-05-01
delete0
PRE
AI
D
Danyang Liu
Y
Yuanqing Xia *
C
Chenggang Shan *
K
Ke Tian
Y
Yufeng Zhan
DOI:10.1016/j.future.2024.107699delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In the cloud-native era, Kubernetes-based workflow engines simplify the execution of containerized workflows. However, these engines face challenges in dynamic environments with continuous workflow requests and unpredictable resource demand peaks. The traditional resource allocation approach, which relies merely on current workflow load data, also lacks flexibility and foresight, often leading to resource over-allocation or scarcity. To tackle these issues, we present a containerized workflow resource allocation (CWRA) scheme designed specifically for Kubernetes workflow engines. CWRA predicts future workflow tasks during the current task pod's lifecycle and employs a dynamic resource scaling strategy to manage high concurrency scenarios effectively. This scheme includes resource discovery and allocation algorithm, which are essential components of our containerized workflow engine (CWE). Our experimental results, across various workflow arrival patterns, indicate significant improvements when compared to the Argo workflow engine. CWRA achieves a reduction in total workflow duration by 0.9% to 11.4%, decreases average workflow duration by a maximum of 21.5%, and increases CPU and memory utilization by 2.07% to 16.95%.
Keyword:
Containerized workflow
Resource allocation
Kubernetes

期刊

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
论文数:
6.9K
被引数:
2.3W

机构

Z
zaozhuang university
学者数:
940
论文数: 664
被引数: 1
B
beijing institute of technology
学者数:
5.5W
论文数: 4.0W
被引数: 63
引用论文

引用论文

Follow-up of short-term child psychiatric inpatient treatment
err2009-07-12
err0
PREAI
errAndre Sourander; Tuula Heikkilä; Hannu Leijala; Anna-Maria Heinisuo; Hans Helenius; Jorma Piha
err分享
err收藏
Borg, Omega, and Kubernetes
err2016-04-26
err368
errOAAI
errBurns, Brendan; Grant, Brian; Oppenheimer, David; Brewer, Eric; Wilkes, John
err分享
err收藏
Adaptive Resource Allocation and Provisioning in Multi-Service Cloud Environments
err2018-01-01
err48
errOAAI
errAlsarhan, Ayoub; Itradat, Awni; Al-Dubai, Ahmed Y.; Zomaya, Albert Y.; Min, Geyong
err分享
err收藏
err分享
err收藏
Lack of Low Frequency Variants Masks Patterns of Non-Neutral Evolution following Domestication
err2011-08-10
err0
errOAAI
errCéline H. Frère; Peter J. Prentis; Edward K. Gilding; Agnieszka M. Mudge; Alan Cruickshank; Ian D. Godwin
err分享
err收藏
学者 查看更多内容