arrow
Return

GCSS: a global collaborative scheduling strategy for wide-area high-performance computing

delete2022-01-08
delete6
PRE
AI
Y
Yao Song
L
Limin Xiao *
L
Liang Wang
G
Guangjun Qin *
韦冰 (Bing Wei)
B
Baicheng Yan
C
Chenhao Zhang
DOI:10.1007/s11704-021-0353-5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Wide-area high-performance computing is widely used for large-scale parallel computing applications owing to its high computing and storage resources. However, the geographical distribution of computing and storage resources makes efficient task distribution and data placement more challenging. To achieve a higher system performance, this study proposes a two-level global collaborative scheduling strategy for wide-area high-performance computing environments. The collaborative scheduling strategy integrates lightweight solution selection, redundant data placement and task stealing mechanisms, optimizing task distribution and data placement to achieve efficient computing in wide-area environments. The experimental results indicate that compared with the state-of-the-art collaborative scheduling algorithm HPS+, the proposed scheduling strategy reduces the makespan by 23.24%, improves computing and storage resource utilization by 8.28% and 21.73% respectively, and achieves similar global data migration costs.
Keywords:
high-performance computing
scheduling strategy
task scheduling
data placement

Journal

Frontiers of Computer Science cover
Frontiers of Computer Science
IF:
4.6
Papers:
1.6K
Citations:
2.8K

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
B
Beijing Union University
Scholars:
1.1K
Papers: 893
Citations: 927