arrow
返回

DPM: A novel distributed large-scale social graph processing framework for link prediction algorithms

delete2018-01-01
delete16
delete
OA
AI
A
Alejandro Corbellini *
D
Daniela Godoy
C
Cristian Mateos
S
Silvia Schiaffino
A
Alejandro Zunino
DOI:10.1016/j.future.2017.02.025delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Large-scale graphs have become ubiquitous in social media. Computer-based recommendations in these huge graphs pose challenges in terms of algorithm design and resource usage efficiency when processing recommendations in distributed computing environments. Moreover, recommendation algorithms for graphs, particularly link prediction algorithms, have different requirements depending of the way the underlying graph is traversed. Path-based algorithms usually perform traversals in different directions to build a large ranking of vertices to recommend, whereas random walk-based algorithms build an initial subgraph and perform several iterations on those vertices to compute the final ranking. In this work, we propose a distributed graph processing framework called Distributed Partitioned Merge (DPM), which supports both types of algorithms and we compare its performance and resource usage w.r.t. two relevant frameworks, namely Fork-Join and Pregel. In our experiments, we show that in most tests DPM outperforms both Pregel and Fork-Join in terms of recommendation time, with a minor penalization in network usage in some scenarios. (C) 2017 Elsevier B.V. All rights reserved.
Keyword:
Distributed graph processing
Recommendation algorithms
Online Social Networks
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

F
Future Generation Computer Systems-The International Journal of eScience
IF:
6.1
论文数:
6.8K
被引数:
2.3W

机构

暂无机构信息
引用论文

引用论文

err分享
err收藏
The role of occupational stress in the association between emotional labor and burnout in nurses: A cross-sectional study
err2020-08-01
err0
PREAI
errFrancesco Zaghini; Valentina Biagioli; Miriana Proietti; Sondra Badolamenti; Jacopo Fiorini; Alessandro Sili
err分享
err收藏
学者 查看更多内容