arrow
返回

A technique for parallel query optimization using MapReduce framework and a semantic-based clustering method

delete2021-06-01
delete2
delete
OA
AI
E
Elham Azhir
N
Nima Jafari Navimipour *
M
Mehdi Hosseinzadeh
A
Arash Sharifi
A
Aso Mohammad Darwesh
DOI:10.7717/peerj-cs.580delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Query optimization is the process of identifying the best Query Execution Plan (QEP). The query optimizer produces a close to optimal QEP for the given queries based on the minimum resource usage. The problem is that for a given query, there are plenty of different equivalent execution plans, each with a corresponding execution cost. To produce an effective query plan thus requires examining a large number of alternative plans. Access plan recommendation is an alternative technique to database query optimization, which reuses the previously-generated QEPs to execute new queries. In this technique, the query optimizer uses clustering methods to identify groups of similar queries. However, clustering such large datasets is challenging for traditional clustering algorithms due to huge processing time. Numerous cloud-based platforms have been introduced that offer low-cost solutions for the processing of distributed queries such as Hadoop, Hive, Pig, etc. This paper has applied and tested a model for clustering variant sizes of large query datasets parallelly using MapReduce. The results demonstrate the effectiveness of the parallel implementation of query workloads clustering to achieve good scalability.
Keyword:
Query optimization
Access plan recommendation
Cluster computing
Parallel Processing
MapReduce
DBSCAN Algorithm
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

PeerJ Computer Science 封面图
PeerJ Computer Science
IF:
2.5
论文数:
3.4K
被引数:
6.9K

机构

I
Islamic Azad University
学者数:
4.0W
论文数: 3.3W
被引数: 9.8K
N
national yunlin university science & technology
学者数:
3.2K
论文数: 3.3K
被引数: 1
G
Gachon University
学者数:
8.2K
论文数: 9.3K
被引数: 8.6K
学者 查看更多机构
引用论文

引用论文

Artificial intelligence approaches and mechanisms for big data analytics: a systematic study
err2021-04-14
err44
errOAAI
errRahmani, Amir Masoud; Azhir, Elham; Ali, Saqib; Mohammadi, Mokhtar; Ahmed, Omed Hassan; Ghafour, Marwan Yassin; Ahmed, Sarkar Hasan; Hosseinzadeh, Mehdi
err分享
err收藏
err分享
err收藏
A taxonomy of software-based and hardware-based approaches for energy efficiency management in the Hadoop
err2019-01-01
err32
PREAI
errShabestari, Fatemeh; Rahmani, Amir Masoud; Navimipour, Nima Jafari; Jabbehdari, Sam
err分享
err收藏
Enhancement of conformational B-cell epitope prediction using CluSMOTE
err2020-06-01
err13
errOAAI
errSolihah, Binti; Azhari, Azhari; Musdholifah, Aina
err分享
err收藏
学者 查看更多内容