arrow
Return

A Shifting Filter Framework for Dynamic Set Queries

delete2023-10-01
delete2
delete
OA
AI
P
Pengtao Fu
L
Lailong Luo *
D
Deke Guo
S
Shangsen Li
Y
Yun Zhou
DOI:10.1109/TNET.2023.3247628delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Set query is a fundamental problem in computer systems. Plenty of applications rely on the query results of membership, association, and multiplicity. A traditional method that addresses such a fundamental problem is derived from Bloom filter. However, such methods may fail to support element deletion, require additional filters or apriori knowledge, making them unamenable to a high-performance implementation for dynamic set representation and query. In this paper, we envision a novel sketch framework that is multi-functional, non-parametric, space efficient, and deletable. As far as we know, none of the existing designs can guarantee such features simultaneously. To this end, we present a general shifting framework to represent auxiliary information (such as multiplicity, association) with the offset. Thereafter, we specify such design philosophy for a hash table horizontally at the slot level, as well as vertically at the bucket level. Theoretical and experimental results jointly demonstrate that our design works exceptionally well with three types of set queries under small memory.
Keywords:
Information filters
Filtering theory
Data structures
Fingerprint recognition
Distributed databases
Throughput
Task analysis
Dynamic set queries
element deletion
Cuckoo filters
Bloom filters
shifting framework

Journal

I
IEEE-ACM Transactions on Networking
IF:
3.6
Papers:
4.4K
Citations:
9.5K

Organization

N
national university of defense technology - china
Scholars:
1.8W
Papers: 1.4W
Citations: 9