arrow
返回

Parallel Processing Systems for Big Data: A Survey

delete2016-11-01
delete59
PRE
AI
Y
Yunquan Zhang *
T
Ting Cao
S
Shigang Li
X
Xinhui Tian
L
Liang Yuan
H
Haipeng Jia
A
Athanasios V. Vasilakos
DOI:10.1109/JPROC.2016.2591592delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The volume, variety, and velocity properties of big data and the valuable information it contains have motivated the investigation of many new parallel data processing systems in addition to the approaches using traditional database management systems (DBMSs). MapReduce pioneered this paradigm change and rapidly became the primary big data processing system for its simplicity, scalability, and fine-grain fault tolerance. However, compared with DBMSs, MapReduce also arouses controversy in processing efficiency, low-level abstraction, and rigid dataflow. Inspired by MapReduce, nowadays the big data systems are blooming. Some of them follow MapReduce's idea, but with more flexible models for general-purpose usage. Some absorb the advantages of DBMSs with higher abstraction. There are also specific systems for certain applications, such as machine learning and stream data processing. To explore new research opportunities and assist users in selecting suitable processing systems for specific applications, this survey paper will give a high-level overview of the existing parallel data processing systems categorized by the data input as batch processing, stream processing, graph processing, and machine learning processing and introduce representative projects in each category. As the pioneer, the original MapReduce system, as well as its active variants and extensions on dataflow, data access, parameter tuning, communication, and energy optimizations will be discussed at first. System benchmarks and open issues for big data processing will also be studied in this survey.
Keyword:
Big data
machine learning
MapReduce
parallel processing
SQL
survey
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Proceedings of the IEEE 封面图
Proceedings of the IEEE
IF:
25.9
论文数:
9.9K
被引数:
4.5W

机构

I
institute of computing technology, cas
学者数:
1.0K
论文数: 878
被引数: 1
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

err分享
err收藏
Secondary structure and hydrogen bonding of crambin in solution A two‐dimensional NMR study
err2005-03-03
err0
errOAAI
errRudolf M. J. N. LAMERICHS; Lawrence J. BERLINER; Rolf BOELENS; Antonio DE MARCO; Miguel LLINÀS; Robert KAPTEIN
err分享
err收藏
MapReduce and Parallel DBMSs: Friends or Foes?MapReduce和并行dbms: 朋友还是敌人?
err2010-01-01
err226
PREAI
errStonebraker, Michael; Abadi, Daniel; Dewitt, David J.; Madden, Sam; Paulson, Erik; Pavlo, Andrew; Rasin, Alexander
err分享
err收藏
Reaction of cobalt tetracarbonyl hydride with phenylacetylene
err1999-07-01
err0
PREAI
errT.Michael Bockman; John F. Garst; Ferenc Ungváry
err分享
err收藏
err分享
err收藏
学者 查看更多内容