.png){kind=icon}
返回
SPFC: An Effective Optimization for Vertex-Centric Graph Processing Systems
.png){kind=icon}
PRE
AI
DOI：10.1109/TSUSC.2017.2780320.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The real-world demands of mining big data and smart data of graph structure have led to an active research of distributed graph processing. Many distributed graph processing systems [19], [22], [23] adopt a vertex-centric programming paradigm. In these systems, messages are passed between vertices to propagate the latest states. The communication efficiency and the high overhead of synchronization are two key considerations of these systems [8], [12]. In this paper, we propose a Slow Passing Fast Consuming (SPFC) approach which can effectively improve the overall performance of vertex-centric graph processing systems. In our approach, the message passing is slow but the consuming is fast. More specifically, at the message sender side, priority is given to those smart messages which contribute more to the algorithm convergence, and at the message receiver side, messages are consumed right after arriving without any delay and intermediate buffer. Besides, by using a two-phase termination check protocol, the global synchronous barrier can be completely eliminated. In addition, based on the slow message passing strategy, further performance improvement can be achieved with some accuracy loss by eliminating those messages which are less useful for algorithm convergence. We implement our approach based on Apache Giraph [1] and evaluate it on a 12-machine cluster. The experimental results show that our method can effectively reduce the amount of message traffic and achieve up to an order of magnitude performance improvement compared with Giraph and GraphLab [3].
Keyword:
Large-scale graph data processing
communication efficiency
smart message
global synchronization
approximate computation
performance improvement
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
I
IF:
5
论文数:
1.8K
被引数:
4.3K
机构
引用论文
Using Seawater Reverse Osmosis (SWRO) desalting system for less environmental impacts in Qatar在卡塔尔使用海水反渗透 (SWRO) 脱盐系统减少环境影响.png)
Desalination
DesalinationIF0
PREAI
分享收藏
Protein-protein interactions: Making sense of networks via graph-theoretic modeling蛋白质-蛋白质相互作用: 通过图论建模理解网络BIOESSAYS
BIOESSAYSIF2.7
PREAI
分享收藏
分享收藏
查看更多内容