arrow
返回

Predictive communication modeling for HPC applications

delete2017-03-24
delete1
PRE
AI
Ν
Νικέλα Παπαδοπούλου *
G
Georgios Goumas
N
Nectarios Koziris
DOI:10.1007/s10586-017-0821-8delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In this paper, we present a methodology for predictive modeling of communication of HPC applications. Communication time depends on a complex set of parameters, relevant to the application, the system architecture, the runtime configuration and runtime conditions. To handle this complexity, we define features that can be extracted from the application, the process mapping and the allocation shape ahead of execution, deploy a single benchmark to sweep over the parameter space and develop predictive models for communication time on two supercomputers, Vilje and Piz Daint, using different subsets of our features, machine-learning methods and training sets. We compare the predictive power of our models on two common communication patterns and one application, for various problem sizes, executions and runtime configurations, ranging from a few dozen to a few thousand cores. Our methodology is successful across all tested communication patterns on both systems and exhibits high prediction accuracy and goodness-of-fit, scoring 23.98% in MMRE, 0.942 in RCC and 61.43% in Pred(0.25) on Vilje and 21.31%, 0.940 and 66.57% respectively on Piz Daint, with models that are applicable just-in-time ahead of the execution of an HPC application.
Keyword:
Predictive modeling
Communication time
MPI applications
Supercomputers
Machine learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

C
Cluster Computing-The Journal of Networks Software Tools and Applications
IF:
4.1
论文数:
5.1K
被引数:
7.5K

机构

N
National Technical University of Athens
学者数:
9.7K
论文数: 9.5K
被引数: 8.2K
引用论文

引用论文

Effect of hydrostatic pressure on Tc in superconducting YNi2−xMxB2C (M = Co, Cu)
err1995-10-01
err0
PREAI
errC. Looney; A.K. Gangopadhyay; A.-K. Klehe; J.S. Schilling
err分享
err收藏
err分享
err收藏
Visuo-motor integration in unresponsive wakefulness syndrome: A piece of the puzzle towards consciousness detection?
err2015-08-19
err0
errOAAI
errAntonino Naro; Antonino Leo; Serena Filoni; Placido Bramanti; Rocco Salvatore Calabrò
err分享
err收藏
err分享
err收藏
Photobiomodulation for depression in animal models
err2019-01-01
err0
PREAI
errFarzad Salehpour; Javad Mahmoudi; Saeed Sadigh-Eteghad; Paolo Cassano
err分享
err收藏
学者 查看更多内容