arrow
返回

GraphOpt: Constrained-Optimization-Based Parallelization of Irregular Graphs

delete2022-12-01
delete1
delete
OA
AI
N
Nimish Shah *
W
Wannes Meert
M
Marian Verhelst
DOI:10.1109/TPDS.2022.3151194delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Sparse, irregular graphs show up in various applications like linear algebra, machine learning, engineering simulations, robotic control, etc. These graphs have a high degree of parallelism, but their execution on parallel threads of modern platforms remains challenging due to the irregular data dependencies. The execution performance can be improved by efficiently partitioning the graphs such that the communication and thread synchronization overheads are minimized without hurting the utilization of the threads. To achieve this, this article proposes GraphOpt, a tool that models the graph parallelization as a constrained optimization problem and uses the open Google OR-Tools solver to find good partitions. Several scalability techniques are developed to handle large real-world graphs with millions of nodes and edges. Extensive experiments are performed on the graphs of sparse matrix triangular solves (linear algebra) and sum-product networks (machine learning), respectively, showing a mean speedup of 2.0x and 1.8x over previous state-of-the-art libraries, demonstrating the effectiveness of the constrained-optimization-based graph parallelization.
Keyword:
Parallel processing
Task analysis
Instruction sets
Synchronization
Hardware
Optimization
Scalability
Graph parallelization
partitioning
constrained optimization
sparse matrix triangular solves
CPU multithreading

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

K
KU Leuven
学者数:
5.7W
论文数: 5.2W
被引数: 8.1W
引用论文

引用论文

The constitution and properties of a pyochelin–zinc complex
err1987-09-01
err0
PREAI
errDiane A. Cuppels; Robert D. Stipanovic; Albert Stoessl; J. B. Stothers
err分享
err收藏
err分享
err收藏
Wealth and Disability in Later Life: The English Longitudinal Study of Ageing (ELSA)
err2016-11-22
err0
errOAAI
errJuliana Lustosa Torres; Maria Fernanda Lima-Costa; Michael Marmot; Cesar de Oliveira
err分享
err收藏
Noradrenergic and peptidergic innervation of lymphoid tissue
err1985-08-01
err0
errOAAI
errDL Felten; SY Felten; SL Carlson; JA Olschowka; S Livnat
err分享
err收藏
学者 查看更多内容