arrow
返回

A novel seq2seq-based prediction approach; workflow scheduling

delete2023-06-11
delete1
PRE
AI
Z
Zhongguo Yang *
M
Mingzhu Zhang
L
Li Han
丁维龙 封面图
丁维龙 (Weilong Ding)
DOI:10.1007/s10586-023-04061-3delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Workflow scheduling problems have been widely studied in cloud computing and edge computing, which aim to exploit cloud-edge resources to execute workflow tasks considering several constraints and optimization goals. However, in the era of Internet of things, the load of each computing task and the amount of data transferred between computing tasks will fluctuate, which changes the original workflow and needs; a new scheduling plan correspondingly. Existing methods are difficult to quickly cope with these dynamic changes and there are few studies applying neural networks to solve problems in workflow scheduling. To bridge the gap, we propose an innovative supervised learning method which leverages function-fitting strategy of neural networks to link the workflow environment and its optimal scheduling plan. Specifically, our approach can be divided into two steps, the first one is to generate dataset and train a seq2seq-based prediction models. In this step, we develop an algorithm; generating a significant amount of workflow instances while ensuring dataset diversity based on complexity estimation. Then we apply GA, NSGA, NSGA-NN three different types GA-based optimization methods to search optimal solutions. Finally, we construct dataset which includes {workflow, environment configurations -> obtained optimal solution} and train a seq2seq-based model. The other part is real-time generation of scheduling plans based on trained seq2seq-based model. Simulation experiments have confirmed that our method is both effective and efficient, demonstrating its ability to adapt to changes in the execution environment, workflow task load, and task data transmission, and effectively schedule tasks in real-time. The simulation results show that the seq2seq-based prediction method can approach 90% of the optimal scheme.
Keyword:
Workflow scheduling
Dynamic scheduling
Seq2Seq model
Function fitting

期刊

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
论文数:
5.1K
被引数:
7.5K

机构

N
North China University of Technology
学者数:
2.0K
论文数: 1.6K
被引数: 962
B
Beijing University of Technology
学者数:
2.8W
论文数: 2.1W
被引数: 2.7W
引用论文

引用论文

Exploration of shared decision making in oncology within the United States: a scoping review
err2022-12-31
err0
errOAAI
errRachel Bennett; Pamela B. DeGuzman; Virginia LeBaron; Daniel Wilson; Randy A. Jones
err分享
err收藏
Characterizing and profiling scientific workflows表征和分析科学工作流
err2013-03-01
err626
PREAI
errJuve, Gideon; Chervenak, Ann; Deelman, Ewa; Bharathi, Shishir; Mehta, Gaurang; Vahi, Karan
err分享
err收藏
err分享
err收藏
err分享
err收藏
Fluctuation-Aware and Predictive Workflow Scheduling in Cost-Effective Infrastructure-as-a-Service Clouds
err2018-01-01
err76
errOAAI
errLi, Weiling; Xia, Yunni; Zhou, Mengchu; Sun, Xiaoning; Zhu, Qingsheng
err分享
err收藏
Domain structure in high molecular weight high mobility group nonhistone chromatin proteins
err1982-11-01
err0
PREAI
errGerald R. Reeck; Paul J. Isackson; David C. Teller
err分享
err收藏
Transcriptomic investigation of meat tenderness in two Italian cattle breeds
err2016-02-09
err0
PREAI
errS. Bongiorni; C. E. M. Gruber; S. Bueno; G. Chillemi; F. Ferrè; S. Failla; B. Moioli; A. Valentini
err分享
err收藏
学者 查看更多内容