arrow
Return

Automatic Irregularity-Aware Fine-Grained Workload Partitioning on Integrated Architectures

delete2019-01-01
delete16
delete
OA
AI
张峰 (Feng Zhang)
J
Jidong Zhai *
B
Bo Wu
B
Bingsheng He
陈文广 cover
陈文广 (Wenguang Chen)
X
Xiaoyong Du *
DOI:10.1109/TKDE.2019.2940184delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The integrated architecture that features both CPU and GPU on the same die is an emerging and promising architecture for fine-grained CPU-GPU collaboration. However, the integration also brings forward several programming and system optimization challenges, especially for irregular applications such as graph processing. The complex interplay between heterogeneity and irregularity leads to very low processor utilization of running irregular applications on integrated architectures. Furthermore, fine-grained co-processing on the CPU and GPU is still an open problem. Particularly, in this paper, we show that the previous workload partitioning for CPU-GPU co-processing is far from ideal in terms of resource utilization and performance. To solve this problem, we propose a system software called FinePar, which considers architectural differences of the CPU and GPU and leverages fine-grained collaboration enabled by integrated architectures. Through irregularity-aware performance modeling and online auto-tuning, FinePar partitions irregular workloads and achieves both device-level and thread-level load balance. We evaluate FinePar with eight irregular applications in graphs and sparse matrices on two integrated architectures and compare it with state-of-the-art partitioning approaches. Results show that FinePar demonstrates better resource utilization and achieves an average of 1.6X speedup over the optimal coarse-grained partitioning method.
Keywords:
Graphics processing units
Computer architecture
Instruction sets
Sparse matrices
Central Processing Unit
Optimization
Load modeling
Heterogeneous computing
integrated architecture
irregular application
workload partitioning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

C
Colorado School of Mines
Scholars:
5.6K
Papers: 5.5K
Citations: 1.0W
T
tsinghua university
Scholars:
11.8W
Papers: 10.0W
Citations: 137
R
Renmin University of China
Scholars:
8.1K
Papers: 7.7K
Citations: 1.1W
N
National University of Singapore
Scholars:
7.5W
Papers: 6.5W
Citations: 11.4W
researcher View more organizations