arrow
Return

MulRF: A Multi-Dimensional Range Filter for Sublinear Time Range Query Processing

delete2024-11-01
delete0
PRE
AI
S
Shuai Han
刘显敏 (Xianmin Liu)
李建忠 (Jianzhong Li) *
DOI:10.1109/TKDE.2024.3397313delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Range query is an important operation on big multi-dimensional data. This paper studies the problem of multi-dimensional range query filtering for speeding up the range query processing by avoiding reading the useless data. To solve the problem, a novel multi-dimensional range filter is proposed to filter the multi-dimensional range queries, while the existing one-dimensional range filters can not provide efficient filtering. Based on the multi-dimensional range filter, an efficient range query processing algorithm is presented. It can directly return the locations of the I/O units that contain the data in the query result without any access to the input dataset. The time complexity of the algorithm is O(3(m)h) , where h is the number of I/O units partially overlapping with a range query, and m is the dimension number. Since m is usually o(root logn) , it is a sublinear time algorithm if V=O(n) , where n is the size of the input dataset, V = & prod;(m)(i=1)d(i) , and di is the number of distinct values on the i -th dimension of the dataset for 1 <= i <= m . Experimental results show that the multi-dimensional range filter has low false positive rate and good filtering efficiency. The proposed range query processing algorithm achieves at least 3 similar to 7 times improvement compared to the one-dimensional filter based algorithms on different datasets.
Keywords:
Filtering algorithms
Query processing
Information filters
Temperature measurement
Extraterrestrial measurements
Time complexity
Electronic mail
Multi-dimensional data
range filter
range query
sublinear time

Journal

IEEE Transactions on Knowledge and Data Engineering cover
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
Papers:
6.8K
Citations:
3.2W

Organization

H
harbin institute of technology
Scholars:
8.0W
Papers: 6.6W
Citations: 66
H
Harbin Engineering University
Scholars:
1.9W
Papers: 1.3W
Citations: 1.3W