arrow
Return

Sparse matrix partitioning for optimizing SpMV on CPU-GPU heterogeneous platforms

delete2019-11-14
delete13
delete
OA
AI
M
Mohamed Akrem Benatia
W
Weixing Ji *
王一拙 (Yizhuo Wang)
F
Feng Shi
DOI:10.1177/1094342019886628delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Sparse matrix-vector multiplication (SpMV) kernel dominates the computing cost in numerous applications. Most of the existing studies dedicated to improving this kernel have been targeting just one type of processing units, mainly multicore CPUs or graphics processing units (GPUs), and have not explored the potential of the recent, rapidly emerging, CPU-GPU heterogeneous platforms. To take full advantage of these heterogeneous systems, the input sparse matrix has to be partitioned on different available processing units. The partitioning problem is more challenging with the existence of many sparse formats whose performances depend both on the sparsity of the input matrix and the used hardware. Thus, the best performance does not only depend on how to partition the input sparse matrix but also on which sparse format to use for each partition. To address this challenge, we propose in this article a new CPU-GPU heterogeneous method for computing the SpMV kernel that combines between different sparse formats to achieve better performance and better utilization of CPU-GPU heterogeneous platforms. The proposed solution horizontally partitions the input matrix into multiple block-rows and predicts their best sparse formats using machine learning-based performance models. A mapping algorithm is then used to assign the block-rows to the CPU and GPU(s) available in the system. Our experimental results using real-world large unstructured sparse matrices on two different machines show a noticeable performance improvement.
Keywords:
Sparse matrix-vector multiplication (SpMV)
CPU-GPU heterogeneous platforms
sparse matrix partitioning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of High Performance Computing Applications cover
International Journal of High Performance Computing Applications
IF:
2.5
Papers:
1.1K
Citations:
1.3K

Organization

B
beijing institute of technology
Scholars:
5.5W
Papers: 4.0W
Citations: 63