arrow
Return

Graph-Centric Performance Analysis for Large-Scale Parallel Applications

delete2024-07-01
delete0
PRE
AI
Y
Yuyang Jin
H
Haojie Wang
R
Runxin Zhong
C
Chen Zhang
X
Xia Liao
张
张峰 (Feng Zhang)
J
Jidong Zhai *
DOI:10.1109/TPDS.2024.3396849delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Performance analysis is essential for understanding the performance behaviors of parallel programs and detecting performance bottlenecks. Whereas, complex interconnections across several types of performance bugs, as well as inter-process communications and data dependence, make efficient performance analysis even more difficult. Despite the fact that many performance tools have been developed, accurately identifying underlying performance bottlenecks for such complex scenarios requires specific in-depth analysis. Significant human efforts and analysis knowledge are often required to implement each specific analytic task. To alleviate the complexity of developing specific performance analytic tasks, we present a programmable performance analysis tool, called PERFLOW. In PERFLOW, a step-by-step performance analysis process is represented as an Analysis Flow Diagram, which is constructed with several performance analysis sub-tasks, namely passes, that can be defined by developers or provided by PERFLOW's built-in analysis pass library. Furthermore, we define a Performance Abstraction Graph to describe the performance behavior of a parallel program, where the edges indicate the interactions between parallel units, therefore the analytic sub-tasks are converted to graph analysis tasks. PERFLOW provides plentiful Python APIs for developing analytic tasks. Several case studies of real-world applications with up to 700 K lines of code are used to demonstrate the effectiveness of PERFLOW. The results indicate that PERFLOW makes it much easier to implement specific performance analytic tasks, and these tasks are performed automatically and efficiently to detect underlying performance bottlenecks.
Keywords:
Parallel applications
performance analysis
dataflow abstraction
graph analysis

Journal

IEEE Transactions on Parallel and Distributed Systems cover
IEEE Transactions on Parallel and Distributed Systems
IF:
6
Papers:
5.2K
Citations:
1.1W

Organization

T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
R
Renmin University of China
Scholars:
8.1K
Papers: 7.7K
Citations: 1.1W
Cited Papers

Cited Papers

Simulating radiating and magnetized flows in multiple dimensions with ZEUS-MP
err2006-07-01
err299
errOAAI
errHayes, John C.; Norman, Michael L.; Fiedler, Robert A.; Bordner, James O.; Li, Pak Shing; Clark, Stephen E.; ud-Doula, Asif; Mac Low, Mordecai-Mark
errShare
errSave
Propylene Glycol Pharmacokinetics and Effects after Intravenous Infusion in Humans
err1987-09-01
err0
PREAI
errP. A. J. Speth; T. B. Vree; N. F. M. Neilen; P. H. M. de Mulder; D. R. Newell; M. E. Gore; B. E. de Pauw
errShare
errSave
QUANTUM ESPRESSO: a modular and open-source software project for quantum simulations of materials
err2009-09-01
err0
errOAAI
errPaolo Giannozzi; Stefano Baroni; Nicola Bonini; Matteo Calandra; Roberto Car; Carlo Cavazzoni; Davide Ceresoli; Guido L Chiarotti; Matteo Cococcioni; Ismaila Dabo; Andrea Dal Corso; Stefano de Gironcoli; Stefano Fabris; Guido Fratesi; Ralph Gebauer; Uwe Gerstmann; Christos Gougoussis; Anton Kokalj; Michele Lazzeri; Layla Martin-Samos; Nicola Marzari; Francesco Mauri; Riccardo Mazzarello; Stefano Paolini; Alfredo Pasquarello; Lorenzo Paulatto; Carlo Sbraccia; Sandro Scandolo; Gabriele Sclauzero; Ari P Seitsonen; Alexander Smogunov; Paolo Umari; Renata M Wentzcovitch
errShare
errSave
WirePrint
err2014-10-05
err0
PREAI
errStefanie Mueller; Sangha Im; Serafima Gurevich; Alexander Teibrich; Lisa Pfisterer; François Guimbretière; Patrick Baudisch
errShare
errSave
researcher View more