arrow
Return

Trends in big data analytics

delete2014-07-01
delete507
PRE
AI
K
Karthik Kambatla *
V
Vipin Kumar
A
Ananth Grama
DOI:10.1016/j.jpdc.2014.01.003delete
deleteOriginal
deleteShare
deleteSave
Abstract

Abstract

En 中文
One of the major applications of future generation parallel and distributed systems is in big-data analytics. Data repositories for such applications currently exceed exabytes and are rapidly increasing in size. Beyond their sheer magnitude, these datasets and associated applications' considerations pose significant challenges for method and software development. Datasets are often distributed and their size and privacy considerations warrant distributed techniques. Data often resides on platforms with widely varying computational and network capabilities. Considerations of fault-tolerance, security, and access control are critical in many applications (Dean and Ghemawat, 2004; Apache hadoop). Analysis tasks often have hard deadlines, and data quality is a major concern in yet other applications. For most emerging applications, data-driven models and methods, capable of operating at scale, are as-yet unknown. Even when known methods can be scaled, validation of results is a major issue. Characteristics of hardware platforms and the software stack fundamentally impact data analytics. In this article, we provide an overview of the state-of-the-art and focus on emerging trends to highlight the hardware, software, and application landscape of big-data analytics. (C) 2014 Elsevier Inc. All rights reserved.
Keywords:
Big-data
Analytics
Data centers
Distributed systems

Journal

Journal of Parallel and Distributed Computing cover
Journal of Parallel and Distributed Computing
IF:
4
Papers:
3.8K
Citations:
4.8K

Organization

Purdue University System cover
Purdue University System
Scholars:
4.0W
Papers: 3.6W
Citations: 66
I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
P
Purdue University
Scholars:
2.7W
Papers: 2.1W
Citations: 147
researcher View more organizations
Cited Papers

Cited Papers

Green Cloud Computing: Balancing Energy in Processing, Storage, and Transport
err2011-01-01
err521
PREAI
errBaliga, Jayant; Ayre, Robert W. A.; Hinton, Kerry; Tucker, Rodney S.
errShare
errSave
Hippocampal Volume Measurement in Older Adults With Bipolar Disorder
err2004-11-01
err0
PREAI
errJohn L. Beyer; Maragatha Kuchibhatla; Martha E. Payne; Melissa Moo-Young; Frederick Cassidy; James MacFall; K. Ranga R. Krishnan
errShare
errSave
Numerical and Experimental Study of a Large-Scale Natural Circulation Helium Loop
err2023-02-22
err0
errOAAI
errBranislav Knížat; Matej Vach; Marek Mlkvik; Peter Mlynár; František Világi; Róbert Olšiak; František Urban
errShare
errSave
Processing high data rate streams in System S
err2011-02-01
err25
PREAI
errAndrade, H.; Gedik, B.; Wu, K-L.; Yu, P. S.
errShare
errSave
Rapid experimental SAD phasing and hot-spot identification with halogenated fragments
err2016-01-01
err0
errOAAI
errJoseph D. Bauman; Jerry Joe E. K. Harrison; Eddy Arnold
errShare
errSave
researcher View more