arrow
返回

Detecting Performance Variance for Parallel Applications Without Source Code

delete2022-12-01
delete0
PRE
AI
J
Jidong Zhai *
L
Liyan Zheng
张
张峰 (Feng Zhang)
X
Xiongchao Tang
H
Haojie Wang
T
Teng Yu
Y
Yuyang Jin
S
Shuaiwen Leon Song
W
Wenguang Chen
DOI:10.1109/TPDS.2022.3181799delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
For parallel applications, performance variance is a critical issue that can degrade performance and make applications' behavior difficult to explain. Therefore, users and application developers should be able to detect and diagnose performance variance. Previous detection methods either introduce too much overhead and slow down applications, or rely on nontrivial source code analysis, which is impractical for production-run parallel systems. In this article, we propose Vapro, a framework for detecting and diagnosing performance variance in production-run parallel systems. Our method is based on an observation that most parallel programs contain code snippets that are executed repeatedly with a fixed workload and can be utilized to detect performance variance. We present State Transition Graph (STG) to track program execution and then do light-weight workload analysis on STG to locate performance variance. Vapro is able to successfully identify these snippets at runtime even without program source code. To diagnose the discovered variation, Vapro uses a progressive diagnosis method based on a hybrid model combining variance breakdown and statistical analysis. According to evaluating results, Vapro's performance overhead is only 1.38% on average. Vapro can identify performance variance in real applications caused by hardware issues, such as memory and IO. The standard deviation of the execution time is decreased by up to 73.5% when the identified variance is fixed. Vapro achieves 30.0% larger detection coverage than the state-of-the-art variance detection approach based on source code analysis.
Keyword:
Codes
Runtime
Hardware
Performance evaluation
Libraries
Benchmark testing
Electric breakdown
Performance variance
anomaly detection
system noise
parallel computing

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
R
Renmin University of China
学者数:
8.1K
论文数: 7.7K
被引数: 1.1W
U
University of Sydney
学者数:
6.5W
论文数: 6.2W
被引数: 90
学者 查看更多机构
引用论文

引用论文

Hyposmia after paranasal sinus extenteration or laryngectomy
err1970-10-01
err0
PREAI
errRobert C. Hoye; Alfred S. Ketcham; Robert I. Henkin
err分享
err收藏
Low-Temperature Crystal Chemistry of Hingganite-(Y), from the Wanni Glacier, Switzerland
err2020-04-04
err0
errOAAI
errLiudmila Gorelova; Oleg Vereshchagin; Stéphane Cuchet; Vladimir Shilovskikh; Dmitrii Pankin
err分享
err收藏
err分享
err收藏
VarCatcher: A Framework for Tackling Performance Variability of Parallel Workloads on Multi-Core
err2017-04-01
err13
PREAI
errZhang, Weihua; Ji, Xiaofeng; Song, Bo; Yu, Shiqiang; Chen, Haibo; Li, Tao; Yew, Pen-Chung; Zhao, Wenyun
err分享
err收藏
Sensing and Monitoring Professional Skiers
err2005-07-01
err0
PREAI
errF. Michahelles; B. Schiele
err分享
err收藏
Luteinizing hormone-releasing hormone in human pituitary blood
err1978-09-01
err0
PREAI
errJ. Lobo Antunes; Peter W. Carmel; Edgar M. Housepian; Michel Ferin
err分享
err收藏
学者 查看更多内容