.png){kind=icon}
返回
Ignis: An efficient and scalable multi-language Big Data framework
.png){kind=icon}
OA
AI
DOI：10.1016/j.future.2019.12.052.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Most of the relevant Big Data processing frameworks (e.g., Apache Hadoop, Apache Spark) only support JVM (Java Virtual Machine) languages by default. In order to support non-JVM languages, subprocesses are created and connected to the framework using system pipes. With this technique, the impossibility of managing the data at thread level arises together with an important loss in the performance. To address this problem we introduce Ignis, a new Big Data framework that benefits from an elegant way to create multi-language executors managed through an RPC system. As a consequence, the new system is able to execute natively applications implemented using non JVM languages. In addition, Ignis allows users to combine in the same application the benefits of implementing each computational task in the best suited programming language without additional overhead. The system runs completely inside Docker containers, isolating the execution environment from the physical machine. A comparison with Apache Spark shows the advantages of our proposal in terms of performance and scalability. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Big data
Multi-language
Performance
Scalability
Container
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
F
IF:
6.1
论文数:
6.8K
被引数:
2.3W
机构
引用论文
Improving the Effectiveness of Burst Buffers for Big Data Processing in HPC Systems with Eley使用Eley提高HPC系统中用于大数据处理的突发缓冲区的有效性OAAI
OAAI分享收藏NurA Is Endowed with Endo- and Exonuclease Activities that Are Modulated by HerA: New Insight into Their Role in DNA-End ProcessingNurA具有受HerA调节的核酸内切酶和核酸外切酶活性: 对其在DNA末端加工中的作用的新见解.png)
PLOS ONE
OAAI
PLOS ONEIF0
OAAI分享收藏 没有更多内容
没有更多内容