arrow
返回

A Survey on Data-driven Performance Tuning for Big Data Analytics Platforms

delete2021-07-01
delete12
PRE
AI
R
Rogério Luís de C. Costa *
J
José Moreira
P
Paulo Pintor
V
Verônica dos Santos
S
Sérgio Lifschitz
DOI:10.1016/j.bdr.2021.100206delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Many research works deal with big data platforms looking forward to data science and analytics. These are complex and usually distributed environments, composed of several systems and tools. As expected, there is a need for a closer look at performance issues. In this work, we review performance tuning strategies in the big data environment. We focus on data driven tuning techniques, discussing the use of database inspired approaches. Concerning big data and NoSQL stores, performance tuning issues are quite different from the so-called conventional systems. Many existing solutions are mostly ad-hoc activities that do not fit for multiple situations. But there are some categories of data-driven solutions that can be taken as guidelines and incorporated into generalpurpose auto-tuning modules for big data systems. We examine typical performance tuning actions, discussing available solutions to support some of the tuning process's primary activities. We also discuss recent implementations of data-driven performance tuning solutions for big data platforms. We propose an initial classification based on the domain state-ofthe-art and present selected tuning actions for large-scale data processing systems. Finally, we organized existing works towards self-tuning big data systems based on this classification and presented general and system-specific tuning recommendations. We found that most of the literature pieces evaluate the use of tuning actions at the physical design perspective, and there is a lack of self-tuning machine learning-based solutions for big data systems. (C) 2021 Elsevier Inc. All rights reserved.
Keyword:
Big data systems
Big data platforms
Performance tuning
Database systems
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Big Data Research 封面图
Big Data Research
IF:
4.2
论文数:
418
被引数:
1.1K

机构

U
universidade de aveiro
学者数:
1.3W
论文数: 1.4W
被引数: 24
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Camptothecin exhibits topoisomerase1-independent KMT1A suppression and myogenic differentiation in alveolar rhabdomyosarcoma cells
err2018-05-25
err0
errOAAI
errDavid W. Wolff; Min-Hyung Lee; Mathivanan Jothi; Munmun Mal; Fengzhi Li; Asoke K. Mal
err分享
err收藏
err分享
err收藏
Computational storage: an efficient and scalable platform for big data and HPC applications
err2019-11-15
err22
errOAAI
errTorabzadehkashi, Mahdi; Rezaei, Siavash; HeydariGorji, Ali; Bobarshad, Hosein; Alves, Vladimir; Bagherzadeh, Nader
err分享
err收藏
Single agent activity of U3-1402, a HER3-targeting antibody-drug conjugate, in HER3-overexpressing metastatic breast cancer: Updated results from a phase I/II trial
err2019-05-01
err0
errOAAI
errK. Yonemori; N. Masuda; S. Takahashi; T. Kogawa; T. Nakayama; Y. Yamamoto; M. Takahashi; T. Toyama; T. Saeki; H. Iwata
err分享
err收藏
Comparison of adiposity indices and cut-off values in the prediction of metabolic syndrome in postmenopausal women
err2016-07-01
err0
PREAI
errAndré B. Gadelha; Jonathan Myers; Sérgio Moreira; Maurílio T. Dutra; Marisete P. Safons; Ricardo M. Lima
err分享
err收藏
Critical analysis of Big Data challenges and analytical methods
err2017-01-01
err1.1K
errOAAI
errSivarajah, Uthayasankar; Kamal, Muhammad Mustafa; Irani, Zahir; Weerakkody, Vishanth
err分享
err收藏
学者 查看更多内容