arrow
Return

Cardinality Estimation in a Virtualized Network Device Using Online Machine Learning

delete2019-10-01
delete20
delete
OA
AI
R
Reuven Cohen *
Y
Yuval Nezri
DOI:10.1109/TNET.2019.2940705delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Cardinality estimation algorithms receive a stream of elements, with possible repetitions, and return the number of distinct elements in the stream. Such algorithms seek to minimize the required memory and CPU resource consumption at the price of inaccuracy in their output. In computer networks, cardinality estimation algorithms are mainly used for counting the number of distinct flows, and they are divided into two categories: sketching algorithms and sampling algorithms. Sketching algorithms require the processing of all packets, and they are therefore usually implemented by dedicated hardware. Sampling algorithms do not require processing of all packets, but they are known for their inaccuracy. In this work we identify one of the major drawbacks of sampling-based cardinality estimation algorithms: their inability to adapt to changes in flow size distribution. To address this problem, we propose a new sampling-based adaptive cardinality estimation framework, which uses online machine learning. We evaluate our framework using real traffic traces, and show significantly better accuracy compared to the best known sampling-based algorithms, for the same fraction of processed packets.
Keywords:
Cardinality estimation
machine learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

I
IEEE-ACM Transactions on Networking
IF:
3.6
Papers:
4.4K
Citations:
9.5K

Organization

T
Technion Israel Institute of Technology
Scholars:
1.6W
Papers: 1.5W
Citations: 2.0W
Cited Papers

Cited Papers

Cardinality Estimation Meets Good-Turing
err2017-09-01
err5
errOAAI
errCohen, Reuven; Katzir, Liran; Yehezkel, Aviv
errShare
errSave
Optical avalanche in Ho:Yb:Gd2O3 nanocrystals
err2011-08-16
err0
PREAI
errY. Dwivedi; A. Bahadur; S. B. Rai
errShare
errSave
Liver Abscess Due to Pyridoxal-Dependent Streptococcus mitis
err1995-07-01
err0
PREAI
errK. W. Shea; P. E. Schoch; N. C. Klein; B. A. Cunha
errShare
errSave
Surface Display of Recombinant Proteins onBacillus subtilisSpores
err2001-11-01
err0
errOAAI
errRachele Isticato; Giuseppina Cangiano; Hoa T. Tran; Annalisa Ciabattini; Donata Medaglini; Marco R. Oggioni; Maurilio De Felice; Gianni Pozzi; Ezio Ricca
errShare
errSave
Circulating Tumor M2 Pyruvate Kinase and Thymidine Kinase 1 Are Potential Predictors for Disease Recurrence in Renal Cell Carcinoma After Nephrectomy
err2010-08-01
err0
PREAI
errBenjamin Nisman; Vladimir Yutkin; Hovav Nechushtan; Ofer N. Gofrit; Tamar Peretz; Simon Gronowitz; Dov Pode
errShare
errSave
errShare
errSave
researcher View more