arrow
返回

Trends in big data analytics

delete2014-07-01
delete507
PRE
AI
K
Karthik Kambatla *
V
Vipin Kumar
A
Ananth Grama
DOI:10.1016/j.jpdc.2014.01.003delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
One of the major applications of future generation parallel and distributed systems is in big-data analytics. Data repositories for such applications currently exceed exabytes and are rapidly increasing in size. Beyond their sheer magnitude, these datasets and associated applications' considerations pose significant challenges for method and software development. Datasets are often distributed and their size and privacy considerations warrant distributed techniques. Data often resides on platforms with widely varying computational and network capabilities. Considerations of fault-tolerance, security, and access control are critical in many applications (Dean and Ghemawat, 2004; Apache hadoop). Analysis tasks often have hard deadlines, and data quality is a major concern in yet other applications. For most emerging applications, data-driven models and methods, capable of operating at scale, are as-yet unknown. Even when known methods can be scaled, validation of results is a major issue. Characteristics of hardware platforms and the software stack fundamentally impact data analytics. In this article, we provide an overview of the state-of-the-art and focus on emerging trends to highlight the hardware, software, and application landscape of big-data analytics. (C) 2014 Elsevier Inc. All rights reserved.
Keyword:
Big-data
Analytics
Data centers
Distributed systems

期刊

Journal of Parallel and Distributed Computing 封面图
Journal of Parallel and Distributed Computing
IF:
4
论文数:
3.8K
被引数:
4.8K

机构

Purdue University System 封面图
Purdue University System
学者数:
3.9W
论文数: 3.6W
被引数: 66
I
international business machines (ibm)
学者数:
5.7K
论文数: 4.5K
被引数: 4
P
Purdue University
学者数:
2.7W
论文数: 2.1W
被引数: 147
学者 查看更多机构
引用论文

引用论文

Green Cloud Computing: Balancing Energy in Processing, Storage, and Transport
err2011-01-01
err521
PREAI
errBaliga, Jayant; Ayre, Robert W. A.; Hinton, Kerry; Tucker, Rodney S.
err分享
err收藏
Hippocampal Volume Measurement in Older Adults With Bipolar Disorder
err2004-11-01
err0
PREAI
errJohn L. Beyer; Maragatha Kuchibhatla; Martha E. Payne; Melissa Moo-Young; Frederick Cassidy; James MacFall; K. Ranga R. Krishnan
err分享
err收藏
Numerical and Experimental Study of a Large-Scale Natural Circulation Helium Loop
err2023-02-22
err0
errOAAI
errBranislav Knížat; Matej Vach; Marek Mlkvik; Peter Mlynár; František Világi; Róbert Olšiak; František Urban
err分享
err收藏
Processing high data rate streams in System S
err2011-02-01
err25
PREAI
errAndrade, H.; Gedik, B.; Wu, K-L.; Yu, P. S.
err分享
err收藏
Rapid experimental SAD phasing and hot-spot identification with halogenated fragments
err2016-01-01
err0
errOAAI
errJoseph D. Bauman; Jerry Joe E. K. Harrison; Eddy Arnold
err分享
err收藏
学者 查看更多内容