arrow
Return

Par-BF: A parallel partitioned Bloom filter for dynamic data sets

delete2016-07-28
delete5
PRE
AI
Y
Yi Liu
X
Xiongzi Ge *
D
David H. C. Du
黄晓霞 cover
黄晓霞 (Xiaoxia Huang)
DOI:10.1177/1094342015618452delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Compared with a hash table, a Bloom filter (BF) is more space efficient for supporting fast matching through a controllable and acceptable false positive probability. The space size of the basic BF is predetermined based on the expected number of elements to be stored. However, we cannot predict the space scale of a BF for dynamic sets. It is still challenging for the two existing solutions, scalable BF (SBF) and dynamic BF (DBF), to manipulate dynamic data sets with low memory overhead but achieving high performance. This article presents a partitioned BF (Par-BF) for dynamic data sets. Compared with DBF and SBF, Par-BF is able to leverage a sweet spot between high performance and low overhead by a group of formulas to support fast concurrent matching. Specifically, the size and the range of the false positive probability in Par-BF can be deliberately derived. From our trace-driven experimental results, the input/output operations per second of Par-BF outperforms that of DBF and SBF by 10x to 14x and by 3x to 8x, respectively. Besides, through our proposed garbage collection policy, Par-BF consumes less than half of the memory usage of SBF.
Keywords:
Bloom filter
dynamic sets
Par-BF
false positive
fast matching
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

International Journal of High Performance Computing Applications cover
International Journal of High Performance Computing Applications
IF:
2.5
Papers:
1.1K
Citations:
1.3K

Organization

S
shenzhen institute of advanced technology, cas
Scholars:
5.6K
Papers: 4.5K
Citations: 7
C
chinese academy of sciences
Scholars:
56.3W
Papers: 44.8W
Citations: 704