arrow
Return

Clustering-based multi-objective optimization considering fairness for multi-workflow scheduling on clouds

delete2024-12-01
delete0
PRE
AI
F
Feng Li
W
Wen Jun Tan
M
Moon Gi Seok *
W
Wentong Cai
DOI:10.1016/j.jpdc.2024.104968delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Distributed computing, such as cloud computing, provides promising platforms for orchestrating scientific workflows' tasks based on their sequences and dependencies. Workflow scheduling plays an important role in optimizing concerned objectives for distributed computing, such as minimizing the makespan and cost. Many researchers have focused on optimizing a specific single workflow with multiple objectives. Currently, there are few studies on multi-workflow scheduling, with most research focusing on objectives such as cost and makespan. However, multi-workflow scheduling requires the design of specific objectives that reflect the unique characteristics of multiple workflows. On the other hand, clustering-based approaches have garnered significant attention in the field of workflow scheduling over distributed computing resources due to their advantage in reducing data communication among tasks. Despite this, the effectiveness of clustering-based algorithms has not been extensively studied and validated in the context of multi-objective multi-workflow scheduling models. Motivated by these factors, we propose an approach for multiple workflows' multi-objective optimization (MOO), considering the new defined metric, fairness. We first mathematically formulate the fairness and define a fairness- involved MOO model. Then, we propose an advanced clustering-based resource optimization strategy in multiple workflow runs. Experimental results show that the proposed approach performs better than the compared algorithms without significant compromise of the overall makespan and cost as well as individual fairness, which can guide the simulation workflow scheduling on clouds.
Keywords:
Multi-objective optimization
Multi-workflow scheduling
Scheduling fairness
Clustering-based resource allocation

Journal

Journal of Parallel and Distributed Computing cover
Journal of Parallel and Distributed Computing
IF:
4
Papers:
3.8K
Citations:
4.8K

Organization

D
Dongguk University
Scholars:
8.2K
Papers: 9.3K
Citations: 1.0W
N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
Cited Papers

Cited Papers

Combined effect of temperature and nutritional regime on the elimination of the lipophilic toxin okadaic acid in the naturally contaminated wedge shell Donax trunculus
err2018-01-01
err0
PREAI
errMaria João Botelho; Carlos Vale; Sandra Joaquim; Sara T. Costa; Florbela Soares; Claúdia Roque; Domitília Matias
errShare
errSave
Towards workflow scheduling in cloud computing: A comprehensive analysis
err2016-05-01
err186
PREAI
errMasdari, Mohammad; ValiKardan, Sima; Shahi, Zahra; Azar, Sonay Imani
errShare
errSave
Performance assessment of multiobjective optimizers: An analysis and review
err2003-04-01
err3.1K
errOAAI
errZitzler, E; Thiele, L; Laumanns, M; Fonseca, CM; da Fonseca, VG
errShare
errSave
Multiobjective Cloud Workflow Scheduling: A Multiple Populations Ant Colony System Approach
err2019-08-01
err204
errOAAI
errChen, Zong-Gan; Zhan, Zhi-Hui; Lin, Ying; Gong, Yue-Jiao; Gu, Tian-Long; Zhao, Feng; Yuan, Hua-Qiang; Chen, Xiaofeng; Li, Qing; Zhang, Jun
errShare
errSave
Antitumor agents. 258. Syntheses and evaluation of dietary antioxidant—taxoid conjugates as novel cytotoxic agents
err2007-09-01
err0
errOAAI
errKyoko Nakagawa-Goto; Koji Yamada; Seikou Nakamura; Tzu-Hsuan Chen; Po-Cheng Chiang; Kenneth F. Bastow; Shao-Chun Wang; Bill Spohn; Mien-Chie Hung; Fang-Yu Lee; Fang-Chen Lee; Kuo-Hsiung Lee
errShare
errSave
SARS-CoV-2 and SARS-CoV Spike-RBD Structure and Receptor Binding Comparison and Potential Implications on Neutralizing Antibody and Vaccine Development
err
IF0
err2020-02-20
err0
PREAI
errChunyun Sun; Long Chen; Ji Yang; Chunxia Luo; Yanjing Zhang; Jing Li; Jiahui Yang; Jie Zhang; Liangzhi Xie
errShare
errSave
researcher View more