.png){kind=icon}
返回
Survey of Distributed Computing Frameworks for Supporting Big Data Analysis
.png){kind=icon}
OA
AI
DOI：10.26599/BDMA.2022.9020014.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Distributed computing frameworks are the fundamental component of distributed computing systems. They provide an essential way to support the efficient processing of big data on clusters or cloud. The size of big data increases at a pace that is faster than the increase in the big data processing capacity of clusters. Thus, distributed computing frameworks based on the MapReduce computing model are not adequate to support big data analysis tasks which often require running complex analytical algorithms on extremely big data sets in terabytes. In performing such tasks, these frameworks face three challenges: computational inefficiency due to high I/O and communication costs, non-scalability to big data due to memory limit, and limited analytical algorithms because many serial algorithms cannot be implemented in the MapReduce programming model. New distributed computing frameworks need to be developed to conquer these challenges. In this paper, we review MapReduce-type distributed computing frameworks that are currently used in handling big data and discuss their problems when conducting big data analysis. In addition, we present a non-MapReduce distributed computing framework that has the potential to overcome big data analysis challenges.
Keyword:
Analytical models
Costs
Computational modeling
Clustering algorithms
Distributed databases
Big Data
Programming
distributed computing frameworks
big data analysis
approximate computing
MapReduce computing model
期刊
IF:
6.2
论文数:
274
被引数:
1.0K
机构
引用论文
A Regional Study on the Influence of Woody and Herbaceous Competition on Early Loblolly Pine Growth
PREAI
分享收藏Two new species of Hylaeus (Nesoprosopis) (Hymenoptera: Colletidae) from O‘ahu, Hawai‘i.png)
Zootaxa
ZootaxaIF0
PREAI
分享收藏An Asymptotic Ensemble Learning Framework for Big Data Analysis一种用于大数据分析的渐近集成学习框架IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAI分享收藏
查看更多内容