arrow
返回

IncPregel: an incremental graph parallel computation model

delete2018-12-19
delete4
PRE
AI
Q
Qiang Liu
X
Xiaoshe Dong
H
Heng Chen *
王银锋 封面图
王银锋 (Yinfeng Wang)
DOI:10.1007/s11704-016-6109-ydelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Large-scale graph computation is often required in a variety of emerging applications such as social network computation and Web services. Such graphs are typically large and frequently updated with minor changes. However, re-computing an entire graph when a few vertices or edges are updated is often prohibitively expensive. To reduce the cost of such updates, this study proposes an incremental graph computation model called IncPregel, which leverages the non-after-effect property of the first-order Markov chain and provides incremental programming abstractions to avoid redundant computation and message communication. This is accomplished by employing an efficient and fine-grained reuse mechanism. We implemented this model on Hama, a popular open source framework based on Pregel, to construct an incremental graph processing system called IncHama. IncHama automatically detects changes in input in order to recognize changed vertices and to exchange reusable data by means of shuffling. The evaluation results on large-scale graphs show that, compared with Hama, IncHama is 1.1-2.7 times faster and can reduce communication messages by more than 50% when the incremental edges increase in number from 0.1 to 100k.
Keyword:
graph computation
Pregel
cloud computing
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Frontiers of Computer Science 封面图
Frontiers of Computer Science
IF:
4.6
论文数:
1.6K
被引数:
2.8K

机构

X
xi'an jiaotong university
学者数:
9.3W
论文数: 6.7W
被引数: 75
S
Shenzhen Institute of Information Technology
学者数:
651
论文数: 812
被引数: 3.5K
引用论文

引用论文

Brainstem iron overload and injury in a rat model of brainstem hemorrhage
err2020-08-01
err0
PREAI
errXi Guo; Lu Ma; Hao Li; Xin Qi; Yang Wei; Zhongxin Duan; Jiake Xu; Chengwei Wang; Chao You; Meng Tian
err分享
err收藏
A Genomewide Screen for Tolerance to Cationic Drugs Reveals Genes Important for Potassium Homeostasis in Saccharomyces cerevisiae
err2011-09-01
err0
errOAAI
errLina Barreto; David Canadell; Silvia Petrezsélyová; Clara Navarrete; Lydie Marešová; Jorge Peréz-Valle; Rito Herrera; Iván Olier; Jesús Giraldo; Hana Sychrová; Lynne Yenush; José Ramos; Joaquín Ariño
err分享
err收藏
Population trends of large non‐migratory wild herbivores and livestock in the Masai Mara ecosystem, Kenya, between 1977 and 1997
err2001-12-24
err0
PREAI
errWilber K. Ottichilo; Jan De Leeuw; Andrew K. Skidmore; Herbert H. T. Prins; Mohammed Y. Said
err分享
err收藏
HADI: Mining Radii of Large GraphsHADI: 挖掘大图的半径
err2011-02-01
err61
PREAI
errKang, U.; Tsourakakis, Charalampos E.; Appel, Ana Paula; Faloutsos, Christos; Leskovec, Jure
err分享
err收藏
学者 查看更多内容