arrow
返回

Enabling Runtime SpMV Format Selection through an Overhead Conscious Method

delete2020-01-01
delete13
PRE
AI
W
Weijie Zhou *
Y
Yue Zhao
X
Xipeng Shen
王琛 封面图
王琛 (Wang Chen)
DOI:10.1109/TPDS.2019.2932931delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Sparse matrix-vector multiplication (SpMV) is an important kernel and its performance is critical for many applications. Storage format selection is to select the best format to store a sparse matrix; it is essential for SpMV performance. Prior studies have focused on predicting the format that helps SpMV run fastest, but have ignored the runtime prediction and format conversion overhead. This work shows that the runtime overhead makes the predictions from previous solutions frequently sub-optimal and sometimes inferior regarding the end-to-end time. It proposes a new paradigm for SpMV storage selection, an overhead-conscious method. Through carefully designed regression models and neural network-based time series prediction models, the method captures the influence imposed on the overall program performance by the overhead and the benefits of format prediction and conversions. The method employs a novel two-stage lazy-and-light scheme to help control the possible negative effects of format predictions, and at the same time, maximize the overall format conversion benefits. Experiments show that the technique outperforms previous techniques significantly. It improves the overall performance of applications by 1.21X to 1.53X, significantly larger than the 0.83X to 1.25X upper-bound speedups overhead-oblivious methods could give.
Keyword:
SpMV
high performance computing
program optimization
sparse matrix format
prediction model
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

I
international business machines (ibm)
学者数:
5.7K
论文数: 4.5K
被引数: 4
N
North Carolina State University
学者数:
2.6W
论文数: 2.3W
被引数: 3.7W
引用论文

引用论文

Amino acid-based enantiomerically pure 3-substituted 1,4-benzodiazepin-2-ones: A new class of anti-ischemic agents
err2007-03-01
err0
PREAI
errJitendra Kumar Mishra; Puja Garg; Preeti Dohare; Ashutosh Kumar; Mohammad Imran Siddiqi; Madhur Ray; Gautam Panda
err分享
err收藏
err分享
err收藏
Purification of Transcripts and Metabolites from <em>Drosophila</em> Heads
err2013-03-15
err0
errOAAI
errKurt Jensen; Jonatan Sanchez-Garcia; Caroline Williams; Swati Khare; Krishanu Mathur; Rita M. Graze; Daniel A. Hahn; Lauren M. McIntyre; Diego E. Rincon-Limas; Pedro Fernandez-Funez
err分享
err收藏
Effects of erythropoietin on depressive symptoms and neurocognitive deficits in depression and bipolar disorder
err2010-10-13
err0
errOAAI
errKamilla W Miskowiak; Maj Vinberg; Catherine J Harmer; Hannelore Ehrenreich; Gitte M Knudsen; Julian Macoveanu; Allan R Hansen; Olaf B Paulson; Hartwig R Siebner; Lars V Kessing
err分享
err收藏
Sparse matrix solvers on the GPU:: Conjugate gradients and multigrid
err2003-07-01
err574
PREAI
errBolz, J; Farmer, I; Grinspun, E; Schröder, P
err分享
err收藏
学者 查看更多内容