arrow
Return

KPU: Kernel Processing Unit for in-Memory Analytical Query Processing

delete2025-08-01
delete0
PRE
AI
J
Jingya Wu
W
Wenyan Lü
H
Haishuang Fan
H
Hao Kong
X
Xiaowei Li
G
Guihai Yan
DOI:10.1109/TC.2025.3569163delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Domain-specific architecture has greatly improved performance and energy efficiency in in-memory databases, especially for accelerating single-functional computing logic in analytic query processing, such as sort, join and aggregation. However, as data volumes surge exponentially, these dedicated accelerators are struggling to satisfy the burgeoning demand for handling intricate and multifaceted workloads. A major challenge lies in establishing a flexible framework that engages these ‘coarse-grained’ units without incurring extra overheads from hardware integration, programming, compilation, runtime and operating systems. In this paper, the kernel processing unit (KPU) is proposed to optimize CPU-accelerator heterogeneous systems for in-memory databases. KPU provides a unified interface to consolidate all database query operators. In terms of KPU hardware architecture, kernel customization and data transmission are two critical bottlenecks. To address the challenges, multiple independently designed homogeneous table cores are integrated to support flexible high-performance SQL queries, and a customized efficient data management system (DMS) works collaboratively to maximize the utilization of on-chip memory bandwidth. Additionally, a database application-specific KPU instruction set architecture (KISA) dedicated to parallel analytical query processing is proposed to enable parallel KPU programming. To trade off between accelerator computing capacity and data transfer latency, KPU designs an offloading mechanism to map SQL queries between the CPU and accelerator adaptively based on a performance model and a function simulator. The experiments demonstrate that KPU surpasses the general-purpose CPU and GPU by an average of 24.5x and 8.75x, respectively.
Keywords:
Database
domain-specific computer architecture
programmability
SQL

Journal

IEEE Transactions on Computers cover
IEEE Transactions on Computers
IF:
3.8
Papers:
5.4K
Citations:
9.8K

Organization

I
Institute of Computing Technology
Scholars:
250
Papers: 114
Citations: 0
Cited Papers

Cited Papers

Accelerating In-memory Database Functionality with FPGAs
err2025-01-31
err0
errOAAI
errLeggett, Jordan; McGlone, John; Demirsoy, Suleyman; Faerber, Christian; Pelyushenko, Vadim
errShare
errSave
A Novel Database Acceleration Technology for Full Table Scans
err2024-01-01
err0
errOAAI
errZhang, Chuang; Tang, Xuebin; Peng, Yuanxi
errShare
errSave
Q100
err2014-02-24
err0
PREAI
errLisa Wu; Andrea Lottarini; Timothy K. Paine; Martha A. Kim; Kenneth A. Ross
errShare
errSave
RAPID
err2018-05-27
err0
PREAI
errCagri Balkesen; Nitin Kunal; Georgios Giannikis; Pit Fender; Seema Sundara; Felix Schmidt; Jarod Wen; Sandeep Agrawal; Arun Raghavan; Venkatanathan Varadarajan; Anand Viswanathan; Balakrishnan Chandrasekaran; Sam Idicula; Nipun Agarwal; Eric Sedlar
errShare
errSave
Bonsai: High-Performance Adaptive Merge Tree Sorting
err2020-05-01
err0
PREAI
errNikola Samardzic; Weikang Qiao; Vaibhav Aggarwal; Mau-Chung Frank Chang; Jason Cong
errShare
errSave
In-memory database acceleration on FPGAs: a survey
err2019-10-26
err0
errOAAI
errJian Fang; Yvo T. B. Mulder; Jan Hidders; Jinho Lee; H. Peter Hofstee
errShare
errSave
GPU Database Systems Characterization and Optimization
err2024-01-20
err0
PREAI
errJiashen Cao; Rathijit Sen; Matteo Interlandi; Joy Arulraj; Hyesoon Kim
errShare
errSave
researcher View more