arrow
返回

Identifying and Estimating Persistent Items in Data Streams

delete2018-12-01
delete27
delete
OA
AI
H
Haipeng Dai *
M
Muhammad Shahzad
A
Alex X. Liu
M
Meng Li
Y
Yuankun Zhong
G
Guihai Chen
DOI:10.1109/TNET.2018.2865125delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
This paper addresses the fundamental problem of finding persistent items and estimating the number of times each persistent item occurred in a given data stream during a given period of time at any given observation point. We propose a novel scheme, PIE, that can not only accurately identify each persistent item with a probability greater than any desired false negative rate (FNR), but can also accurately estimate the number of occurrences of each persistent item. The key idea of PIE is that it uses Raptor codes to encode the ID of each item that appears at the observation point during a measurement period and stores only a few bits of the encoded ID in the memory. The item that is persistent occurs in enough measurement periods that enough encoded bits for the ID can be retrieved from the observation point to decode them correctly and get the ID of the persistent item. To estimate the number of occurrences of any given persistent item, PIE uses maximum likelihood estimation-based statistical techniques on the information already recorded during the measurement periods. We implemented and evaluated PIE using three real network traffic traces and compared its performance with three prior schemes. Our results show that PIE not only achieves the desire FNR in every scenario, its average FNR can be 19.5 times smaller than the FNR of the adapted prior scheme. Our results also show that PIE achieves any desired success probability in estimating the number of occurrences of persistent items.
Keyword:
Persistent item
identification
estimation
Bloom filter
Raptor code
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

I
IEEE-ACM Transactions on Networking
IF:
3.6
论文数:
4.4K
被引数:
9.5K

机构

N
nanjing university
学者数:
7.8W
论文数: 5.6W
被引数: 87
N
North Carolina State University
学者数:
2.6W
论文数: 2.3W
被引数: 3.7W
引用论文

引用论文

Mastering the surface strain of platinum catalysts for efficient electrocatalysis掌握高效电催化铂催化剂的表面应变
err2021-10-06
err0
PREAI
errTianou He; Weicong Wang; Fenglei Shi; Xiaolong Yang; Xiang Li; Jianbo Wu; Yadong Yin; Mingshang Jin
err分享
err收藏
Finding the Frequent Items in Streams of Data
err2009-10-01
err67
PREAI
errCormode, Graham; Hadjieleftheriou, Marios
err分享
err收藏
Amustaline (S‐303) treatment inactivates high levels of Zika virus in red blood cell components
err2017-02-05
err0
errOAAI
errAndrew Laughhunn; Felicia Santa Maria; Julien Broult; Marion C. Lanteri; Adonis Stassinopoulos; Didier Musso; Maite Aubry
err分享
err收藏
The Synthesis and in Vitro Cytotoxicity of Two trans-Platinum Complexes of Heterocyclic Amines
err2003-01-01
err0
PREAI
errGeorgina Giannikopoulos; Chih-Lynne Teo; Matthew D. Hall; Ronald R. Fenton; Trevor W. Hambley
err分享
err收藏
Star-Shaped Silacyclobutene-Containing π-Systems: Synthesis and Optical Properties
err2008-12-29
err0
PREAI
errJunhui Liu; Shaoguang Zhang; Wen-Xiong Zhang; Zhenfeng Xi
err分享
err收藏
Non-Axisymmetrical (Life-Like) Abdominal Aortic Aneurysm Models: A Do-It-Yourself Approach
err2003-12-01
err0
PREAI
errArindam Chaudhuri; Leslie E. Ansdell; Robin Richards; Mohan Adiseshiah; Anthony J. Grass
err分享
err收藏
学者 查看更多内容