.png){kind=icon}
返回
Knowledge-based job scheduling for HPC
.png){kind=icon}
PRE
AI
DOI：10.1007/s10586-024-04734-7.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Scheduling jobs for executing atop large-scale High-Performance Computing (HPC) infrastructures is a fundamental administrative challenge essential to maximize the productivity indicators of such complex Data Centers (DCs). Several policies were proposed by specialized literature, considering specific scenarios and applications, or proposing DC-tailored heuristics. However, the definition of the appropriate policy depends directly on the applications and infrastructure load, that is, indicators that vary over time. Given this context, this work advances the field on applying Machine Learning (ML) techniques to improve the existing scheduling policies. Specifically, we propose Knowledge-based Job Scheduler (KJS), which uses regression techniques to characterize the performance indicators of existing schedulers, composing a knowledge database, and instead of proposing a one-size-fits-all scheduling function, KJS consolidates the information and uses data classification for defining the jobs' execution order. The simulation campaign demonstrates that KJS can adapt to different workloads when compared to the individual use of existing policies. Essentially, KJS combines polynomial data regression and classification;
improving the per;
mance indicators of HPC DC, in both the users' and the administrators' perspectives.
Keyword:
Scheduling
Supervised learning
Linear regression
High performance computing
期刊
C
IF:
4.1
论文数:
5.1K
被引数:
7.5K
机构
引用论文
GARLSched: Generative adversarial deep reinforcement learning task scheduling optimization for large-scale high performance computing systemsGARLSched: 大规模高性能计算系统的生成对抗深度强化学习任务调度优化
PREAI
分享收藏DAG-based workflows scheduling using Actor-Critic Deep Reinforcement Learning使用Actor-crristic深度强化学习的基于DAG的工作流调度
PREAI
分享收藏分享收藏Actor-Critic Deep Reinforcement Learning for Solving Job Shop Scheduling Problems.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏
查看更多内容