arrow
Return

Correlation Expert Tuning System for Performance Acceleration

delete2022-11-01
delete0
delete
OA
AI
柴艳峰 (Yanfeng Chai)
J
Jiake Ge
张强 (Qiang Zhang)
柴云鹏 cover
柴云鹏 (Yunpeng Chai)
X
Xin Wang *
张庆鹏 cover
张庆鹏 (Qingpeng Zhang)
DOI:10.1016/j.bdr.2022.100345delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
One configuration can not fit all workloads and diverse resources limitations in modern databases. Auto-tuning methods based on reinforcement learning (RL) normally depend on the exhaustive offline training process with a huge amount of performance measurements, which includes large inefficient knobs combinations under a trial-and-error method. The most time-consuming part of the process is not the RL network training but the performance measurements for acquiring the reward values of target goals like higher throughput or lower latency. In other words, the whole process nearly could be considered as a zero-knowledge method without any experience or rules to constrain it. So we propose a correlation expert tuning system (CXTuning) for acceleration, which contains a correlation knowledge model to remove unnecessary training costs and a multi-instance mechanism (MIM) to support finegrained tuning for diverse workloads. The models define the importance and correlations among these configuration knobs for the user's specified target. But knobs-based optimization should not be the final destination for auto-tuning. Furthermore, we import an abstracted architectural optimization method into CXTuning as a part of the progressive expert knowledge tuning (PEKT) algorithm. Experiments show that CXTuning can effectively reduce the training time and achieve extra performance promotion compared with the state-of-the-art auto-tuning method. (C) 2022 The Authors. Published by Elsevier Inc.
Keywords:
Auto-tuning
Database optimization
Correlation expert rules
Reinforcement learning
Training time reduction
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Big Data Research cover
Big Data Research
IF:
4.2
Papers:
406
Citations:
1.1K

Organization

B
Beijing Jiaotong University
Scholars:
2.2W
Papers: 1.7W
Citations: 1.2W
T
tianjin university
Scholars:
7.9W
Papers: 5.7W
Citations: 88
R
Renmin University of China
Scholars:
8.1K
Papers: 7.7K
Citations: 1.1W
T
taiyuan university of science & technology
Scholars:
3.5K
Papers: 2.3K
Citations: 3
C
City University of Hong Kong
Scholars:
2.3W
Papers: 3.0W
Citations: 6.1W
researcher View more organizations