arrow
返回

G-Learned Index: Enabling Efficient Learned Index on GPU

delete2024-06-01
delete1
PRE
AI
J
Jiesong Liu
张
张峰 (Feng Zhang) *
L
Lu Lv
Q
Qi Chang
X
Xiaoguang Guo
D
Dong Deng
G
Guoliang Li
张焕晨 封面图
张焕晨 (Huanchen Zhang)
J
Jidong Zhai
H
Hechen Zhang
Y
Yuxing Chen
A
Anqun Pan
X
Xiaoyong Du
DOI:10.1109/TPDS.2024.3381214delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
AI and GPU technologies have been widely applied to solve Big Data problems. The total data volume worldwide reaches 200 zettabytes in 2022. How to efficiently index the required content among massive data becomes serious. Recently, a promising learned index has been proposed to address this challenge: It has extremely high efficiency while retaining marginal space overhead. However, we notice that previous learned indexes have mainly focused on CPU architecture, while ignoring the advantages of GPU. Because traditional indexes like B-Tree, LSM, and bitmap have greatly benefited from GPU acceleration, a combination of a learned index and GPU has great potentials to reach tremendous speedups. In this paper, we propose a GPU-based learned index, called G-Learned Index, to significantly improve the performance of learned index structures. The primary challenges in developing G-Learned Index lie in the use of thousands of GPU cores including minimization of synchronization and branch divergence, data structure design for parallel operations, and usage of memory bandwidth including limited memory transactions and multi-memory hierarchy. To overcome these challenges, a series of novel technologies are developed, including efficient thread organization, succinct data structures, and heterogeneous memory hierarchy utilization. Compared to the state-of-the-art learned index, the proposed G-Learned Index achieves an average of 174x speedup (and 107x of its parallel version). Meanwhile, we attain 2x less query time over the state-of-the-art GPU B-Tree. Our further exploration of range queries shows that G-Learned Index is 17x faster than CPU multi-dimensional learned index.
Keyword:
Learned index
parallel
GPU
acceleration

期刊

IEEE Transactions on Parallel and Distributed Systems 封面图
IEEE Transactions on Parallel and Distributed Systems
IF:
6
论文数:
5.2K
被引数:
1.1W

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
R
Renmin University of China
学者数:
8.1K
论文数: 7.7K
被引数: 1.1W
R
rutgers university system
学者数:
4.1W
论文数: 3.7W
被引数: 53
R
rutgers university new brunswick
学者数:
2.3W
论文数: 1.9W
被引数: 32
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Pavo: A RNN-Based Learned Inverted Index, Supervised or Unsupervised?
err2019-01-01
err13
errOAAI
errXiang, Wenkun; Zhang, Hao; Cui, Rui; Chu, Xing; Li, Keqin; Zhou, Wei
err分享
err收藏
学者 查看更多内容