arrow
返回

Exploiting Data Skew for Improved Query Performance

delete2022-05-01
delete4
delete
OA
AI
W
Wangda Zhang *
K
Kenneth A. Ross
DOI:10.1109/TKDE.2020.3006446delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Analytic queries enable sophisticated large-scale data analysis within many commercial, scientific and medical domains today. Data skew is a ubiquitous feature of these real-world domains. In a retail database, some products are typically much more popular than others. In a text database, word frequencies follow a Zipf distribution with a small number of very common words, and a long tail of infrequent words. In a geographic database, some regions have much higher populations (and therefore data measurements) than others. Current systems do not make the most of caches for exploiting skew. In particular, a whole cache line may remain cache resident even though only a small part of the cache line corresponds to a popular data item. In this article, we propose a novel index structure for repositioning data items to concentrate popular items into the same cache lines. The net result is better spatial locality, and better utilization of limited cache resources. We develop a theoretical model for analyzing the cache utilization, and implement database operators that are efficient in the presence of skew. Our experimental evaluation on real and synthetic data shows that exploiting skew can significantly improve in-memory query performance. In some cases, our techniques can speed up queries by over an order of magnitude.
Keyword:
Indexes
Prefetching
Arrays
Hardware
Data skew
query processing
permutation index
cache optimization
SIMD
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

C
Columbia University
学者数:
7.1W
论文数: 6.4W
被引数: 263
引用论文

引用论文

Lack of influence of sex hormones on Brugada syndrome-associated mutant Nav1.5 sodium channel
err2019-01-01
err0
PREAI
errGuodong Yang; Jing Liu; Ya Wang; Yuan Du; Aiqun Ma; Tingzhong Wang
err分享
err收藏
Descent for semiorthogonal decompositions
err2021-03-01
err0
errOAAI
errBenjamin Antieau; Elden Elmanto
err分享
err收藏
Infrared studies of the superconducting energy gap and normal-state dynamics of the high-TcsuperconductorYBa2Cu3O7
err1990-06-01
err0
PREAI
errZ. Schlesinger; R. T. Collins; F. Holtzberg; C. Feild; G. Koren; A. Gupta
err分享
err收藏
A meta‐synthesis of qualitative studies on stress urinary incontinence in women for the development of a Core Outcome Set: A systematic review
err2021-10-11
err0
PREAI
errMaria Patricia Rada; Stephanie Jones; Cornelia Betschart; Gabriele Falconi; Jorge Milhem Haddad; Stergios K. Doumouchtsis
err分享
err收藏
Processing and Thermal Conductivity of Lead Telluride Microwires
err2014-03-31
err0
PREAI
errRudra P. Bhatta; Sezhian Annamalai; Marek Brandys; Ian L. Pegg; Biprodas Dutta
err分享
err收藏
Breaking the Memory Wall in MonetDB
err2008-12-01
err143
errOAAI
errBoncz, Peter A.; Kersten, Martin L.; Manegold, Stefan
err分享
err收藏
学者 查看更多内容