arrow
返回

Graphine: Programming Graph-Parallel Computation of Large Natural Graphs for Multicore Clusters

delete2016-06-01
delete8
PRE
AI
J
Jie Yan
G
Guangming Tan
Z
Zeyao Mo *
N
Ninghui Sun *
DOI:10.1109/TPDS.2015.2453978delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Graph-parallel computation has become a crucial component in emerging applications of web search, data analytics and machine learning. In practice, most graphs derived from real-world phenomena are very large and scale-free. Unfortunately, distributed graph-parallel computation of these natural graphs still suffers strong scalability issues on contemporary multicore clusters. To embrace the multicore architecture in distributed graph-parallel computation, we propose the framework Graphine, which features (i) A Scatter-Combine computation abstraction that is evolved from the traditional vertex-centric approach by fusing the paired scatter and gather operations, executed separately on two edge sides, into a one-sided scatter. Further coupled with active message mechanism, it potentially reduces intermediate message cost and enables fine-grained parallelism on multicore architecture. (ii) An Agent-Graph data model, which leverages an idea similar to vertex-cut but conceptually splits the remote replica into two agent types of scatter and combiner, resulting in less communication. We implement the Graphine framework and evaluate it using several representative algorithms on six large real-world graphs and a series of synthetic graphs with power-law degree distributions. We show that Graphine achieves sublinear scalability with the number of cores per node, number of nodes, and graph sizes (up to one billion vertices), and is 2 similar to 15 times faster than the state-of-the-art PowerGraph on a cluster of 16 multicore nodes.
Keyword:
Graph-parallel
parallel framework
computational model
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

I
institute of computing technology, cas
学者数:
1.0K
论文数: 877
被引数: 1
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

The hapticity of η-indenyl complexes: molecular structures of [(η5-C9R7)Rh(η4-cod)](R = H, Me)(cod = cyclo-octa-5-diene)
err1989-01-01
err0
PREAI
errAshok K. Kakkar; Simon F. Jones; Nicholas J. Taylor; Scott Collins; Todd B. Marder
err分享
err收藏
err分享
err收藏
err分享
err收藏
Paraná magmatism and the opening of the South Atlantic
err1992-11-27
err0
PREAI
errC. J. Hawkesworth; K. Gallagher; S. Kelley; M. Mantovani; D. W. Peate; M. Regelous; N. W. Rogers
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Evaluation of Ice-Adhesion Strength on Erosion-Resistant Materials
err2015-07-01
err0
PREAI
errJared Soltis; Jose Palacios; Timothy Eden; Douglas Wolfe
err分享
err收藏
Simultaneously inhibiting undecaprenyl phosphate production and peptidoglycan synthases promotes rapid lysis in Escherichia coli
err2019-05-06
err0
errOAAI
errMatthew A. Jorgenson; William J. MacCain; Bernadette M. Meberg; Suresh Kannan; Joseph C. Bryant; Kevin D. Young
err分享
err收藏
Biologically Inspired Soft Robot for Thumb Rehabilitation1
err2014-04-28
err0
PREAI
errPaxton Maeder-York; Tyler Clites; Emily Boggs; Ryan Neff; Panagiotis Polygerinos; Dónal Holland; Leia Stirling; Kevin Galloway; Catherine Wee; Conor Walsh
err分享
err收藏
学者 查看更多内容