.png){kind=icon}
返回
Predicting queue wait time probabilities for multi-scale computing
.png){kind=icon}
OA
AI
DOI：10.1098/rsta.2018.0151.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We describe a method for queue wait time prediction in supercomputing clusters. It was designed for use as a part of multi-criteria brokering mechanisms for resource selection in a multi-site High Performance Computing environment. The aim is to incorporate the time jobs stay queued in the scheduling system into the selection criteria. Our method can also be used by the end users to estimate the time to completion of their computing jobs. It uses historical data about the particular system to make predictions. It returns a list of probability estimates of the form (t(i), p(i)), where pi is the probability that the job will start before time ti. Times ti can be chosen more or less freely when deploying the system. Compared to regression methods that only return a single number as a queue wait time estimate (usually without error bars) our prediction system provides more useful information. The probability estimates are calculated using the Bayes theorem with the naive assumption that the attributes describing the jobs are independent. They are further calibrated to make sure they are as accurate as possible, given available data. We describe our service and its REST API and the underlying methods in detail and provide empirical evidence in support of the method's efficacy. This article is part of the theme issue 'Multiscale modelling, simulation and computing: from the desktop to the exascale'.
Keyword:
multi-scale computing
machine learning
Naive Bayes
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
P
IF:
3.7
论文数:
7.8K
被引数:
2.8W
机构
引用论文
.png){kind=icon}
Development of Science Gateways Using QCG - Lessons Learned from the Deployment on Large Scale Distributed and HPC Infrastructures使用QCG开发科学网关-从大规模分布式和HPC基础架构的部署中吸取的经验教训
PREAI
分享收藏Scanning force microscopy and effective medium theory study of free‐standing polyaniline thin films扫描力显微镜和有效介质理论研究自由支撑聚苯胺薄膜
PREAI
分享收藏Mass Transport Processes at Porous Electrocatalysts in the Electrogenerative Reactor多孔电催化剂在电生成反应器中的质量传递过程
PREAI
分享收藏分享收藏
查看更多内容