arrow
Return

Enabling Runtime SpMV Format Selection through an Overhead Conscious Method

delete2020-01-01
delete13
PRE
AI
W
Weijie Zhou *
Y
Yue Zhao
X
Xipeng Shen
王琛 cover
王琛 (Wang Chen)
DOI:10.1109/TPDS.2019.2932931delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Sparse matrix-vector multiplication (SpMV) is an important kernel and its performance is critical for many applications. Storage format selection is to select the best format to store a sparse matrix; it is essential for SpMV performance. Prior studies have focused on predicting the format that helps SpMV run fastest, but have ignored the runtime prediction and format conversion overhead. This work shows that the runtime overhead makes the predictions from previous solutions frequently sub-optimal and sometimes inferior regarding the end-to-end time. It proposes a new paradigm for SpMV storage selection, an overhead-conscious method. Through carefully designed regression models and neural network-based time series prediction models, the method captures the influence imposed on the overall program performance by the overhead and the benefits of format prediction and conversions. The method employs a novel two-stage lazy-and-light scheme to help control the possible negative effects of format predictions, and at the same time, maximize the overall format conversion benefits. Experiments show that the technique outperforms previous techniques significantly. It improves the overall performance of applications by 1.21X to 1.53X, significantly larger than the 0.83X to 1.25X upper-bound speedups overhead-oblivious methods could give.
Keywords:
SpMV
high performance computing
program optimization
sparse matrix format
prediction model
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Parallel and Distributed Systems cover
IEEE Transactions on Parallel and Distributed Systems
IF:
6
Papers:
5.2K
Citations:
1.1W

Organization

I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
N
North Carolina State University
Scholars:
2.6W
Papers: 2.3W
Citations: 3.7W
Cited Papers

Cited Papers

Amino acid-based enantiomerically pure 3-substituted 1,4-benzodiazepin-2-ones: A new class of anti-ischemic agents
err2007-03-01
err0
PREAI
errJitendra Kumar Mishra; Puja Garg; Preeti Dohare; Ashutosh Kumar; Mohammad Imran Siddiqi; Madhur Ray; Gautam Panda
errShare
errSave
Purification of Transcripts and Metabolites from <em>Drosophila</em> Heads
err2013-03-15
err0
errOAAI
errKurt Jensen; Jonatan Sanchez-Garcia; Caroline Williams; Swati Khare; Krishanu Mathur; Rita M. Graze; Daniel A. Hahn; Lauren M. McIntyre; Diego E. Rincon-Limas; Pedro Fernandez-Funez
errShare
errSave
Effects of erythropoietin on depressive symptoms and neurocognitive deficits in depression and bipolar disorder
err2010-10-13
err0
errOAAI
errKamilla W Miskowiak; Maj Vinberg; Catherine J Harmer; Hannelore Ehrenreich; Gitte M Knudsen; Julian Macoveanu; Allan R Hansen; Olaf B Paulson; Hartwig R Siebner; Lars V Kessing
errShare
errSave
Sparse matrix solvers on the GPU:: Conjugate gradients and multigrid
err2003-07-01
err574
PREAI
errBolz, J; Farmer, I; Grinspun, E; Schröder, P
errShare
errSave
researcher View more