arrow
返回

Cost-Effective Empirical Performance Modeling

delete2026-01-22
delete0
PRE
AI
M
Marcus Ritter *
B
Benedikt Naumann
A
Alexandru Calotoiu
S
Sebastian Rinke
T
Thorsten Reimann
T
Torsten Hoefler
F
Felix Wolf
DOI:10.1109/TPDS.2025.3646119delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Performance models help us to understand how HPC applications scale, which is crucial for efficiently utilizing HPC resources. They describe the performance (e.g., runtime) as a function of one or more execution parameters (e.g., problem size and the degree of parallelism). Creating one manually for a given program is challenging and time-consuming. Automatically learning a model from performance data is a viable alternative, but potentially resource-intensive. Extra-P is a tool that implements this approach. The user begins by selecting values for each parameter. Each combination of values defines a possible measurement point. The choice of measurement points affects the quality and cost of the resulting models, creating a complex optimization problem. A naive approach takes measurements for all possible measurement points, the number of which grows exponentially with the number of parameters. In our earlier work, we demonstrated that a quasi-linear number of points is sufficient and that prioritizing the least expensive points is a generic strategy with a good trade-off between cost and quality. Here, we present an improved selection strategy based on Gaussian process regression (GPR) that selects points individually for each modeling task. In our synthetic evaluation, which was based on tens of thousands of artificially generated functions, the naive approach achieved 66% accuracy with two model parameters and 5% artificial noise. At only 10% of the na & iuml;ve approach's cost, the generic approach already achieved 47.3% accuracy, while the GPR-based approach achieved even 77.8% accuracy. Similar improvements were observed in experiments involving different numbers of model parameters and noise levels, as well as in case studies with realistic applications.
Keyword:
Mathematical models
Costs
Accuracy
Noise measurement
Noise level
Noise
Gaussian processes
Size measurement
Optimization
Computational modeling
Performance analysis
performance modeling
high-performance computing
parallel processing
reinforcement learning
Gaussian process regression

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

T
technical university of darmstadt
学者数:
483
论文数: 200
被引数: 0
E
eth zurich
学者数:
2.3K
论文数: 1.1K
被引数: 0
S
swiss federal institutes of technology domain
学者数:
9.0W
论文数: 8.0W
被引数: 163
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Score-P: A Unified Performance Measurement System for Petascale Applications
err2011-11-08
err0
PREAI
errDieter an Mey; Scott Biersdorf; Christian Bischof; Kai Diethelm; Dominic Eschweiler; Michael Gerndt; Andreas Knüpfer; Daniel Lorenz; Allen Malony; Wolfgang E. Nagel; Yury Oleynik; Christian Rössel; Pavel Saviankou; Dirk Schmidl; Sameer Shende; Michael Wagner; Bert Wesarg; Felix Wolf
err分享
err收藏
Quicksilver: A Proxy App for the Monte Carlo Transport Code Mercury快银:Mercury蒙特卡罗输运代码的代理应用程序
err2017-09-01
err0
errOAAI
errDavid F. Richards; Ryan C. Bleile; Patrick S. Brantley; Shawn A. Dawson; Michael Scott McKinley; Matthew J. O'Brien
err分享
err收藏
Surrogate Models for Analyzing Performance Behavior of HPC Applications Using the RAJA Performance Suite
err2025-01-01
err0
PREAI
errBogale,Befikir; Lumsden,Ian; Sukkari,Dalal; Yokelson,Dewi; Brink,Stephanie; Pearce,Olga; Taufer,Michela
err分享
err收藏
Exascaling Your Library
err2015-06-08
err0
PREAI
errSergei Shudler; Alexandru Calotoiu; Torsten Hoefler; Alexandre Strube; Felix Wolf
err分享
err收藏
err分享
err收藏
学者 查看更多内容