.png){kind=icon}
返回
Scatter-Gather-Merge: An efficient star-join query processing algorithm for data-parallel frameworks
.png){kind=icon}
PRE
AI
DOI：10.1007/s10586-010-0144-5.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
A data-parallel framework is very attractive for large-scale data processing since it enables such an application to easily process a huge amount of data on commodity machines. MapReduce, a popular data-parallel framework, is used in various fields such as web search, data mining and data warehouses; it is proven to be very practical for such a data-parallel application. A star-join query is a popular query in data warehouses that are a current target domain of data-parallel frameworks. This article proposes a new algorithm that efficiently processes star-join queries in data-parallel frameworks such as MapReduce and Dryad. Our star-join algorithm for general data-parallel frameworks is called Scatter-Gather-Merge, and it processes star-join queries in a constant number of computation steps, although the number of participating dimension tables increases. By adopting bloom filters, Scatter-Gather-Merge reduces a non-trivial amount of IO. We also show that Scatter-Gather-Merge can be easily applied to MapReduce. Our experimental results in both cluster and cloud environments show that Scatter-Gather-Merge outperforms existing approaches.
Keyword:
Data parallel framework
MapReduce
Hadoop
Star-join query
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
C
IF:
4.1
论文数:
5.1K
被引数:
7.5K
机构
引用论文
分享收藏
Concentrations of myo-inositol in the luminal fluid of the mammalian testis and epididymis.png)
Reproduction
OAAI
ReproductionIF0
OAAI分享收藏Homogeneous catalytic carbonylation of nitroaromatics Part III. Discovery and in situ high pressure FTIR spectral studies of a novel binuclear ruthenium catalyst硝基芳族化合物的均相催化羰基化部分III.新型双核钌催化剂的发现和原位高压FTIR光谱研究
PREAI
分享收藏Characteristics and modelling of BDS satellite inter-frequency clock bias for triple-frequency PPP
PREAI
分享收藏 没有更多内容
没有更多内容