.png){kind=icon}
返回
Predicting optimal sparse general matrix-matrix multiplication algorithm on GPUs
.png){kind=icon}
PRE
AI
DOI：10.1177/10943420241231928.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Sparse General Matrix-Matrix Multiplication (SpGEMM) has played an important role in a number of applications. So far, many efficient algorithms have been proposed to improve the performance of SpGEMM on GPUs. However, the performance of each algorithm for matrices of different structures varies a lot. There is no algorithm that can achieve the optimal performance of SpGEMM computation on all matrices. In this article, we design a machine learning based approach for predicting the optimal SpGEMM algorithm on input matrices. By extracting features from input matrices, we utilize LightGBM and XGBoost to train different lightweight models. The models are capable of predicting the best performing algorithm with low inference overhead and high accuracy for the given input matrices. We also investigate the impact of tree depth on model accuracy and inference overhead. Our evaluation shows that an increase in tree depth leads to a corresponding increase in prediction accuracy, reaching a maximum of approximately 85%, while resulting in increased inference overhead of approximately 10 A mu s. Compared with the state-of-the-art algorithms on three GPU platforms, our method achieves better overall performance.
Keyword:
Sparse general matrix-matrix multiplication
graphics processing unit
machine learning
gradient boosting decision tree
期刊
IF:
2.5
论文数:
1.1K
被引数:
1.3K
机构
引用论文
A framework for general sparse matrix-matrix multiplication on GPUs and heterogeneous processors基于gpu和异构处理器的通用稀疏矩阵-矩阵乘法框架
OAAI
OAAI分享收藏Development of long-distance efferent projections from fetal hippocampal grafts depends upon pathway specificity and graft location in kainate-lesioned adult hippocampus.png)
Neuroscience
NeuroscienceIF0
PREAI
分享收藏
查看更多内容