arrow
返回

Processing Cassandra Datasets with Hadoop-Streaming Based Approaches

delete2016-01-01
delete14
PRE
AI
E
Elif Dede
B
Bedri Sendir
P
P. Kuzlu
J
J. Weachock
M
M. Govindaraju *
L
Lavanya Ramakrishnan *
DOI:10.1109/TSC.2015.2444838delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The progressive transition in the nature of both scientific and industrial datasets has been the driving force behind the development and research interests in the NoSQL model. Loosely structured data poses a challenge to traditional data store systems, and when working with the NoSQL model, these systems are often considered impractical and costly. As the quantity and quality of unstructured data grows, so does the demand for a processing pipeline that is capable of seamlessly combining the NoSQL storage model and a Big Data processing platform such as MapReduce. Although MapReduce is the paradigm of choice for data-intensive computing, Java-based frameworks such as Hadoop require users to write MapReduce code in Java while Hadoop Streaming module allows users to define non-Java executables as map and reduce operations. When confronted with legacy C/C++ applications and other non-Java executables, there arises a further need to allow NoSQL data stores access to the features of Hadoop Streaming. We present approaches in solving the challenge of integrating NoSQL data stores with MapReduce under non-Java application scenarios, along with advantages and disadvantages of each approach. We compare Hadoop Streaming alongside our own streaming framework, MARISSA, to show performance implications of coupling NoSQL data stores like Cassandra with MapReduce frameworks that normally rely on file-system based data stores. Our experiments also include Hadoop-C*, which is a setup where a Hadoop cluster is co-located with a Cassandra cluster in order to process data using Hadoop with non-java executables.
Keyword:
Hadoop-streaming
Cassandra
MapReduce
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Services Computing 封面图
IEEE Transactions on Services Computing
IF:
5.8
论文数:
2.2K
被引数:
6.5K

机构

S
state university of new york (suny) system
学者数:
6.5W
论文数: 5.8W
被引数: 65
B
binghamton university, suny
学者数:
2.5K
论文数: 2.0K
被引数: 1
引用论文

引用论文

Preliminary Development of the Climate and Racial Justice Scale
err2024-10-01
err0
PREAI
errRegina M. Musicaro; McKenna Parnes; Sarah R. Lowe; Susan Clayton; Cheryl Holder; Sarah E. O. Schwartz
err分享
err收藏
Gyrokinetic particle simulations of reversed shear Alfvén eigenmode excited by antenna and fast ions
err2010-11-09
err0
PREAI
errWenjun Deng; Zhihong Lin; Ihor Holod; Xin Wang; Yong Xiao; Wenlu Zhang
err分享
err收藏
Optimized production of large Bose-Einstein condensates
err2006-04-18
err0
errOAAI
errD. Comparat; A. Fioretti; G. Stern; E. Dimova; B. Laburthe Tolra; P. Pillet
err分享
err收藏
学者 查看更多内容