arrow
Return

Upscaledb: Efficient integer-key compression in a key-value store using SIMD instructions

delete2017-06-01
delete4
delete
OA
AI
D
Daniel Lemire *
C
Christoph Rupp
DOI:10.1016/j.is.2017.01.002delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Compression can sometimes improve performance by making more of the data available to the processors faster. We consider the compression of integer keys in a B+-tree index. For this purpose, systems such as IBM DB2 use variable-byte compression over differentially coded keys. We revisit this problem with various compression alternatives such as Google's VarintGB, Binary Packing and Frame-of-Reference. In all cases, we describe algorithms that can operate directly on compressed data. Many of our alternatives exploit the single-instruction-multiple-data (SIMD) instructions supported by modern CPUs. We evaluate our techniques in a database environment provided by Upscaledb, a production-quality key value database. Our best techniques are SIMD accelerated: they simultaneously reduce memory usage while improving single-threaded speeds. In particular, a differentially coded SIMD binary-packing techniques (BP128) can offer a superior query speed (e.g., 40% better than an uncompressed database) while providing the best compression (e.g., by a factor of ten). For analytic workloads, our fast compression techniques offer compelling benefits. Our software is available as open source. (C) 2017 Elsevier Ltd. All rights reserved.
Keywords:
B plus -tree
Data compression
Vectorization
Key-value stores
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Enterprise Information Systems cover
Enterprise Information Systems
IF:
3.9
Papers:
2.8K
Citations:
1.8K

Organization

U
universite teluq
Scholars:
113
Papers: 101
Citations: 2
U
university of quebec
Scholars:
2.0W
Papers: 1.9W
Citations: 19
Cited Papers

Cited Papers

Magnitude of Reinforcement and Consummatory Behavior
err1959-07-31
err0
PREAI
errJohn D. Davis; J. D. Keehn
errShare
errSave
Lack of influence of sex hormones on Brugada syndrome-associated mutant Nav1.5 sodium channel
err2019-01-01
err0
PREAI
errGuodong Yang; Jing Liu; Ya Wang; Yuan Du; Aiqun Ma; Tingzhong Wang
errShare
errSave
SeeingHaptics
err2019-10-01
err0
PREAI
errLiwei Chan; Mu-Hsuan Chen; Wen-Chi Ho; Roshan Lalintha Peiris; Bing-Yu Chen
errShare
errSave
A meta‐synthesis of qualitative studies on stress urinary incontinence in women for the development of a Core Outcome Set: A systematic review
err2021-10-11
err0
PREAI
errMaria Patricia Rada; Stephanie Jones; Cornelia Betschart; Gabriele Falconi; Jorge Milhem Haddad; Stergios K. Doumouchtsis
errShare
errSave
Influence of Various Basin Types on Performance of Passive Solar Still: A Review
err2021-11-01
err0
PREAI
errTri Hieu Le; Minh Tuan Pham; H Hadiyanto; Van Viet Pham; Anh Tuan Hoang
errShare
errSave
researcher View more