arrow
Return

PAGE: A Partition Aware Engine for Parallel Graph Computation

delete2015-02-01
delete19
PRE
AI
Y
Yingxia Shao
崔斌 cover
崔斌 (Bin Cui) *
L
Lin Ma
DOI:10.1109/TKDE.2014.2327037delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Graph partition quality affects the overall performance of parallel graph computation systems. The quality of a graph partition is measured by the balance factor and edge cut ratio. A balanced graph partition with small edge cut ratio is generally preferred since it reduces the expensive network communication cost. However, according to an empirical study on Giraph, the performance over well partitioned graph might be even two times worse than simple random partitions. This is because these systems only optimize for the simple partition strategies and cannot efficiently handle the increasing workload of local message processing when a high quality graph partition is used. In this paper, we propose a novel partition aware graph computation engine named PAGE, which equips a new message processor and a dynamic concurrency control model. The new message processor concurrently processes local and remote messages in a unified way. The dynamic model adaptively adjusts the concurrency of the processor based on the online statistics. The experimental evaluation demonstrates the superiority of PAGE over the graph partitions with various qualities.
Keywords:
Graph computation
graph partition
message processing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.9K
Citations:
3.2W

Organization

P
peking university
Scholars:
11.9W
Papers: 8.7W
Citations: 146
Cited Papers

Cited Papers

Classifying hand sensorimotor functions of the chronic kidney disease patients using novel manual tactile test and pinch-holding-up activity
err2019-07-11
err0
errOAAI
errI-Te Tu; Yu-Shiuan Cheng; Pu-Chun Mo; Hsiu-Yun Hsu; Li-Chieh Kuo; I-Ming Jou; Fong-Chin Su
errShare
errSave
The hapticity of η-indenyl complexes: molecular structures of [(η5-C9R7)Rh(η4-cod)](R = H, Me)(cod = cyclo-octa-5-diene)
err1989-01-01
err0
PREAI
errAshok K. Kakkar; Simon F. Jones; Nicholas J. Taylor; Scott Collins; Todd B. Marder
errShare
errSave
Should Angiotensin-Converting Enzyme Inhibitors Be Continued Over the Long Term in Patients Whose Left Ventricular Ejection Fraction Normalizes After an Episode of Acute Myocarditis?
err2006-01-01
err0
PREAI
errManuel Anguita-Sánchez; Juan C. Castillo-Domínguez; Dolores Mesa-Rubio; Martín Ruiz-Ortiz; Amador López-Granados; José Suárez de Lezo
errShare
errSave
Structural elucidation of synthetic calcium silicates
err2012-02-29
err0
PREAI
errThomas Borrmann; James H. Johnston; Andrew J. McFarlane; Kenneth J. D. MacKenzie; Akihiko Nukui
errShare
errSave
Islands on Islands: Habitats on Inselbergs
err2000-01-01
err0
PREAI
errS. Porembski; U. Becker; R. Seine
errShare
errSave
Evaluation of Ice-Adhesion Strength on Erosion-Resistant Materials
err2015-07-01
err0
PREAI
errJared Soltis; Jose Palacios; Timothy Eden; Douglas Wolfe
errShare
errSave
Simultaneously inhibiting undecaprenyl phosphate production and peptidoglycan synthases promotes rapid lysis in Escherichia coli
err2019-05-06
err0
errOAAI
errMatthew A. Jorgenson; William J. MacCain; Bernadette M. Meberg; Suresh Kannan; Joseph C. Bryant; Kevin D. Young
errShare
errSave
Biologically Inspired Soft Robot for Thumb Rehabilitation1
err2014-04-28
err0
PREAI
errPaxton Maeder-York; Tyler Clites; Emily Boggs; Ryan Neff; Panagiotis Polygerinos; Dónal Holland; Leia Stirling; Kevin Galloway; Catherine Wee; Conor Walsh
errShare
errSave
researcher View more