返回
A Survey on Data-driven Performance Tuning for Big Data Analytics Platforms
DOI:10.1016/j.bdr.2021.100206.png)
摘要
En 中文
Many research works deal with big data platforms looking forward to data science and analytics. These are complex and usually distributed environments, composed of several systems and tools. As expected, there is a need for a closer look at performance issues. In this work, we review performance tuning strategies in the big data environment. We focus on data driven tuning techniques, discussing the use of database inspired approaches. Concerning big data and NoSQL stores, performance tuning issues are quite different from the so-called conventional systems. Many existing solutions are mostly ad-hoc activities that do not fit for multiple situations. But there are some categories of data-driven solutions that can be taken as guidelines and incorporated into generalpurpose auto-tuning modules for big data systems. We examine typical performance tuning actions, discussing available solutions to support some of the tuning process's primary activities. We also discuss recent implementations of data-driven performance tuning solutions for big data platforms. We propose an initial classification based on the domain state-ofthe-art and present selected tuning actions for large-scale data processing systems. Finally, we organized existing works towards self-tuning big data systems based on this classification and presented general and system-specific tuning recommendations. We found that most of the literature pieces evaluate the use of tuning actions at the physical design perspective, and there is a lack of self-tuning machine learning-based solutions for big data systems. (C) 2021 Elsevier Inc. All rights reserved.
Keyword:
Big data systems
Big data platforms
Performance tuning
Database systems
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
4.2
论文数:
418
被引数:
1.1K
机构
引用论文
Benchmarking big data architectures for social networks data processing using public cloud platforms
Camptothecin exhibits topoisomerase1-independent KMT1A suppression and myogenic differentiation in alveolar rhabdomyosarcoma cells
Oncotarget
IF0
Computational storage: an efficient and scalable platform for big data and HPC applications
JOURNAL OF BIG DATA
IF6.4
Incidence of Dementia in Relation to Genetic Variants at PITX2, ZFHX3, and ApoE ε4 in Atrial Fibrillation Patients房颤患者中与PITX2,ZFHX3和apoeε4遗传变异相关的痴呆发生率

