arrow
Return

LASER: Buffer-Aware Learned Query Scheduling in Master-Standby Databases

delete2025-04-07
delete0
PRE
AI
Y
Yuwei Huang *
DOI:10.14778/3712221.3712239delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Master-standby database deployment is a commonly adopted database architecture in modern production environments, thanks to its fault tolerance and high availability. However, despite the architecture's widespread application in various online services, relatively few research efforts have been made to improve its overall query performance. When a sequence of queries arrive, existing methods of scheduling them across master and standby servers still rely on rules or heuristics, which may overlook some potential optimization directions such as buffer utilization. If we can efficiently reuse the database buffers resident in memory through intelligent query scheduling, the average response time of user queries can be significantly reduced as opposed to reading data from disk. To address this issue, in this paper, we introduce a new buffer-aware query scheduling system named LASER. The system integrates a lightweight learned model that can directly map a query to the data blocks it accesses. Then, based on the predictions of the queries, we develop adaptive query scheduling algorithms to perform query allocation as well as query rearrangements, aiming to maximize the overall buffer hit rate while also maintaining load balance. The proposed system requires no pre-training, and can adjust to unseen workloads on the fly through constant model updates and query re-allocation. In our experiments, we observe a reduction of similar to 80% in query completion time compared to other traditional heuristic-based methods, with relatively low extra overhead added to the critical path of query execution.
Keywords:
TUNING SYSTEM

Journal

P
Proceedings of the VLDB Endowment
IF:
3.3
Papers:
563
Citations:
1.2W

Organization

No organization information available
Cited Papers

Cited Papers

Multi-dimensional resource scheduling for parallel queries
err1996-06-01
err0
PREAI
errMinos N. Garofalakis; Yannis E. Ioannidis
errShare
errSave
QTune
err2019-08-01
err0
PREAI
errGuoliang Li; Xuanhe Zhou; Shifu Li; Bo Gao
errShare
errSave
Deployment of query plans on multicores
err2014-11-01
err0
errOAAI
errJana Giceva; Gustavo Alonso; Timothy Roscoe; Tim Harris
errShare
errSave
Distribution-based query scheduling
err2013-07-01
err0
errOAAI
errYun Chi; Hakan Hacígümüş; Wang-Pin Hsiung; Jeffrey F. Naughton
errShare
errSave
An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning
err2019-06-25
err0
PREAI
errJi Zhang; Yu Liu; Ke Zhou; Guoliang Li; Zhili Xiao; Bin Cheng; Jiashu Xing; Yangtao Wang; Tianheng Cheng; Li Liu; Minwei Ran; Zekang Li
errShare
errSave
openGauss
err2021-10-28
err0
PREAI
errGuoliang Li; Xuanhe Zhou; Ji Sun; Xiang Yu; Yue Han; Lianyuan Jin; Wenbo Li; Tianqing Wang; Shifu Li
errShare
errSave
FACE
err2022-01-14
err0
PREAI
errJiayi Wang; Chengliang Chai; Jiabin Liu; Guoliang Li
errShare
errSave
researcher View more